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(54) Medical Information processing system for supporting diagnosis 



(57) A medical information processing system for 
supporting diagnosis, capable of displaying an original 
image and a minified image over the original image 
without being interfered to each other, capable of opti- 
mal man-power & time saving configurations and meth- 
ods, capable of realizing an optimal classifying 
technique for doctor's interpretation and CAD-proc- 
essed result, and capable of optimizing efficiency in 
forming accurate interpretation report by using PACS in 
a mass survey. The system includes: a detecting unit for 
detecting location of abnormality from a first medical 
image in accordance with a predetermined algorithm: 
an image forming unit for forming a second medical 
image in which a marker indicating the location of the 
abnormality is overlapped: and a display unit for display- 
ing the first medical image and the second medical 
image in an optimally efficient way. 
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Description 

BACKGROUND OF THE IIWEMTIQN 

Technical Reld 

[0001] The present invention relates to a medical information processing system for comparing a plurality of (fiag- 
nositic information Including doctors' findings and results of computerized analysis of images and other examination 
data and thus supporting doctors in evaluating examination more ^idently. 

ParfsflTQUfri Art 

[0002] Generally, an image diagnosis in medical institutes will be carried out according to the following procedures: 

(1) An examination requesting department (for example, the Department of Intemal Medicine) requests the Depart- 
ment of Radiology to carry out an image examination for a patient (for example, X-rays. CT, MRl or the like). This 
request is performed by issuing an examination request sheet in which the following items are written: 

The items of the examination request sheet contain: a patient ID number, a patient name, a date of birth, a sex. 
a name of examination requesting department a name of examination requesting doctor, an examination modality 
(an X-ray machine, an X-ray computed tomography machine, a magnetic resonance imaging machine etc.). a 
region to be examined, a procedure of examination, a purpose of examination, clinical information and the like; 

(2) An examination enginner of the Department of Radiology makes an examination (an image acquisition) of a 
patient according to contents of the examination request sheet to develop it on a film; 

(3) An interpreting doctor interprets the developed films. At this time, it is often material to refer to the past exami- 
nation results (the past image) of the patient to obtain higher interpreting quality. When the interpreting doctor has 
completed the image, he/she will prepare an interpretation report The following items will be described in this inter- 
pretation report: 

These items include a finding from interpretation, a conclusion, a name of the interpreting doctor, a date of the 
interpretation, and the like; and 

(4) This interpretation report is returned to the examination requesting doctor to finish image diagnostic operations. 

[0003] By the way. as a digital image has a characteristic that it sinplifies a computerized image processing, this fea- 
ture facilitates attempts of analyzing digital images using a computer to detect patient abnormalities. This has bom 
fruits. The technology is called a Computer-Aided Diagnosis (CAD), which is expected to furtiier improve accuracy in 
the image diagnosis and reduce a load to the interpreting doctor and the doctor in charge of the patient. 
[0004] A great number of literatures are described concerning an algorithm for detecting patient abnormalities in this 
computer-aided diagnosis. For instance, the following literatures are to be referred to: 

(1) Katsuragawa. S. et al: Image Feature Analysis and Computer-Aided Disgnosis in Digital Radiography: Classifi- 
cation of Normal and Abnormal Lungs with Interstitial Disease In Chest Images. Medical Physics 16.38-44(1989). 

(2) Giger. M. L. et al: Image Feature Analysis and Computer-Aided Disgnosis in Digital Radiography: 3. Automated 
Detection of Nodules in Peripheral Lung Fields. Medical Physics 15.158-166 (1988). 

(3) Chan, H. P. et al: Image Feature Analysis and Computer-Aided Diagnosis in Digital Radiography: 1 . Automated 
Detection of Microcalcifications in Mammography. Medical Physics 14.538-548 (1987). 

(4) Dol. K. et al: Possibility of Corpputer-aided Diagnosis in Digital Radiograpl^. Nippon Acta Radiologica 1989- 
45(5): 653-663. 

(5) Obatake, H.. Kubo, J., Okada, M.: Pneumoconiosis Shadow Absti^ction in X-ray Radiography by Equidensity 
Ray Processing and Applications to Automatic Diagnosis. Electronic Intelligence and Communicatfon Academic 
Paper; D-Vol.J76-D-No.2 pp.261-267. February, 1993. 

(6) Shimizu. A.. Hasegawa, J.. Torlwaki. J.: Minimum Orientation Differential RIter for Detecting Massive Shadow 
in Chest X-ray Image and its Nature. Electronic Intelligence and Communication, Academic Paper; D-Vol.J76-D- 
No.2 PP241-249. February. 1993. 

(7) Matsumoto, K.. Kin. K., Obata. H.: Growth Shadow Detection in DR Image - Iris Filter; Electronk; Intelligence 
and Communication Academic Paper; D-Vol.J75-D-Na3 pp.663-670. March, 1992. 

(8) Suzuku, H., Inaoka. N.. Takahana, H,. Morimasa, M., Sasaoka, S.. Natori. H., Suzuku, A.: Lung Growth Auto- 
matk; Detecting System in Chest X-ray Direct Radiographing Image - Diagnosis Support for Lung Cancer. 

[0005] The description concerning a device implementing technologies for detecting abnormalities has been dis- 
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closed in the following official gazettes: Japanese Patent Laid-Open Na 2-185240. Japanese Patent Laid-Open No. 2- 
152443. and Japanese Patent Laid-Open No. 1-125675. 

[0006] Each of the devices for detecting abnormalities which are disclosed in these literatures is common in that a 
certain type of abnormality is automatically detected from images for digital medical purposes by using computing 
means and that this detected abnormality is superposed on such images to display it. Fig. 1 shows a display embodi- 
ment in which this detected abnormality changes itself in its shape according to its type and is superposed on such 
images to display it. 

[0007] Furthermore, with the progress of digitized imaging, a Picture Archiving Communication System (hereinafter. 
PACS) has been used to realize a smoothness in this image disgnosis business and space-saving for keeping data. The 
PACS stores, communicates, and displays medical images p<-ray images. CT images. MR images, or the like) pro- 
duced in the medical institutes, thus contrbuting to assist doctors in the business of observing the medical images. 
Therefore, the PACS stores image data sent from various modalities in a database and transfers requested image data 
from a database in reply to a demand made from an image workstation located in each consultation room etc.. and the 
image workstation displays such image on its Cathode Ray Tube (hereinafter, CRT) etc. An interpretation report can be 
prepared on the image workstation in the PACS and stored tiierein. 

[0008] This PACS arranges and stores films in a storing rack. It becomes unnecessary to search objective films from 
the storing rack, carry films, hook or unhook films on a film viewer, or the like, tiiereby participating in the benefits of the 
system unusing films. This PACS has been disclosed in many literatures: Japanese Patent (.aid-Open No. 62-121576, 
Japanese Patent Laid-Open No. 63-10269, Japanese Patent Laid-Open No. 64-13837. Japanese Patent Laid-Open No! 
64-1 71 54. Japanese Patent Laid-Open Na 2-1 03668. Japanese Patent Laid-Open No. 2- 1 1 9840 etc. 
[0009] For example, Japanese Patent Laid-Open Na 2-1 85240 has disclosed the PACS having lA (a function of input- 
ting images). WS-ANA (a function of abstracting the feature amount by analyzing images), and WS-OUT (a function of 
displaying images and overlays), as shown in a function block of Fig. 1 1 . 

[0010] A series of operations from an input of image to an output of analyzed results is earned out in the following 
procedures: 

(1) A doctor inputs digital images (hereinafter referred to as an "original image") of a specific chest X-ray radiogra- 
phy by the lA. 

(2) A Computer-Aided Diagnosis processing (CAD processing) is performed for the original image by the WS-ANA. 
The original image Is fractionated so that, for example, about 1 to 2 minute region(s) having 6.4mm square exists 
among respective ribs. The original image is computer-analyzed to output the feature amount each region con'e- 
spending to a shadow scope of each region. Presence or absence of abnormalities of a pulmonary interstitial dis- 
ease or its progressing degree is examined and a type of abnormalities is classified based on the feature amount 
in each region. For example, presence or absence off abnormalities is decided corresponding to a magnitude of the 
feature amount. Furthermore, tiie classification is carried out conresponding to comparative results of the feature 
anwunt witii a plurality of threshold values set previously The progressing degree is computed coresponding to 
the degree of difference between tiie feature amount and the feature value of the threshold value. 

(3) According to a doctor's request, the PACS displays in a condition that CAD processing results are superposed 
on the original image. As shown in Fig. 12. a shape of marker is changed corresponding to a type of abnormalities 
and a magnitude of marker is changed corresponding to the progressing degree to display CAD processing results 
which are superposed on images. Herein, markers are distinguished as follows: a marker "square" is a reticular 
type: a mariner "hexagon" is a honeycomb type; and a marker "circle" is a nodular type. 

[001 1 ] As described above, as a marker of the CAD processing results is superposed on the original image to display 
them, the image of a marker portion is interfered with the marker and is not seen behind it Then, since it was necessary 
that a doctor amtched a display mode alternatively or frequently into a mode displaying only the original image and a 
mode displaying by superposing a marker of the CAD processing results on the original image to advance interpreting 
operations, not only it was extremely troublesome, but also the interpreting time was prolonged and efficiency in the 
interpreting operations was reduced. These were drawtiacks. 

[0012] At present, various medical group examinations are made in Japan, including therein examinations accompa- 
nying a medical image diagnosis (one of medical examination data) such as a chest X-ray examination, a stomach X- 
ray radiography examination, or tiie lika When a lung cancer examination is picked up as an example, a flow of busi- 
ness from an examination to a report of results is carried out In the following procedures: 

Step 1) Decide a date of a medical examination and notify a person to be examined of the date. 
Step 2) Make an oral examination. Information such as a previous illness of the examined person, late conditions 
of the illness, a smoker or a non-smoker, a degree of smoking, or tiie like is available in the oral examination. 
Step 3) Perform a chest X-ray radiography. In many cases, the radiography is performed in a car for a medical 
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examination. 

Step 4) Interpret a chest X-ray Image. The interpretation of an Image is carried out by two or more doctors. If they 
recognize a doubtful abnormal finding, they judge that a dose examination for the person Is required. 
Step 5) Notify the exanuned person of the results. 

5 

[001 3] In this connection, the examination of sputum is also made in the lung cancer examination, however its descrip- 
tion Is omitted here. There are a plurality of types of examination in said Step 4. and for example, when two doctors car- 
ries out the interpretation of an image, the following types of examination are typical: 

10 (a) Two doctors independently interpret an image in separate places (refer to Fig. 36A). 
(b) Two doctors simultaneously interpret the same image (refer to Fig. 36B). 

[001 4] In the both types (a) and (b). if one of two doctors indicates a doubtful abnomality. he^he judges that the exam- 
ined person of the image is required to make a close examination. 
16 [001 5] There are two methods of executing such medical group examination, namely a case where a local self-gov- 
ernment body or a public health center carries out Steps 1 to 5 and a case where a company to which a person to be 
examined belongs carries out Steps 1 , 5 and a specific medical institute or a technical company for a medical exami- 
nation cames out Steps 2 to 4. The place in which the procedures of Steps 2 to 4 are canied out is called a center. The 
center has a film storage for keeping examination films of each year and a data storage for keeping data such as doc- 
20 tors' interpretation results, oral infbrmation obtained by examining the person, and the like. As for the chest X-ray radi- 
ography, the center prepares a chest X-ray radiography car and a radiologist on a reqested date for the radiography, and 
the center reqests a doctor of the other medical institute to interpret an image to be examined. Further, the center deliv- 
ers a doctor images and printed forms for interpretation findings and comes to receive tiie images and the printed forms 
into which the interpretation findings are filled after completing interpretation of the images According to the interpre- 
ts tation results, the images are classified into ones requiring a dose examination and ones being normal, and then the 
center sends the ordered company information such as classification results, doctor's interpretation results concerning 
a person requiring a dose examination, examination images, oral examinations, or the like (carry out said Step 5). 
[001 6] A doctor who is requested to interpret an image on a lung cancer examination works overtime after the normal 
business hours, and a time for interpreting an image is limited. Furthermore, it takes a few minutes per sheet of image 
30 to interpret an image in the normal business, while as the number of sheets of image which is requested to interpret 
expands to several hundred sheets at one time, it takes about 1 0 seconds per sheet of image to interpret an image and 
it is considerably short. Furthermore, a chest X-ray radiograph to be interpreted in tiie normal business is imaged in a 
direct radiography and its Image has a size of 14 inches x 14 inches (about 35 cm) or more and excellent image quality, 
while an image for a lung cancer examination is imaged in a min-or indirect radiography, and has a small size of 10 cm 
35 x 10 cm with a roll film and inferior image quality. Accordingly, although tiie medical group examination is a job having 
an object of discovering a lung cancer in an earlier stage, it is pointed out that a lung cancer in an earlier stage is often 
overlooked. 

[001 7] At present, it takes a week until the center delivers an interpretation material to a first doctor after the medical 
examination and it also takes a week until the center receives interpretation results after the delivery to the doctor, and 

40 namely it takes two weeks by two doctors. As it takes a week until the center reports the results to the examined person 
after the receipt of the results obtained by two doctors, and namely It takes a month until tiie examined person receives 
the results after the medical examination. Furthermore, tiie person Is then made a close examination to be diagnosed 
as a tumor and judged as a malignancy or a benignancy so that an operation or an appropriate medical treatment shall 
be performed. Accordingly it is ordinary that a considerable time further passes after the medical examination. On the 

45 otiier hand, since a cancer (malign tumor) grows fairly faster and the more a cancer is discovered in the early stage, tiie 
more the person is convalesdng satisfactorily, it is desired to shorten a period from a medical examination to an oper- 
ation or a commencement of a medical treatment Also, it is the present conditions tiiat a digital image system for a 
medical groip examination has not been constructed. 

[0018] By the way. since a digital image has a feature that it is easy to perform an Image processing by a computer 
so unlike an analog image such as radiographic films etc., this digital image Is analyzed by a computer to detect abnormal- 
ities and fruits are obtained in this operations. This technique is. as have been described, called a Computer-Aided 
Diagnosis (hereinafter referred to as X AD") and It Is expected to enhance accuracy In an Image diagnosis and to dimin- 
ish a load to doctors. 

[001 9] As described above, it is pointed out that a doctor often overlooks abnormalities in interpreting an examination 
55 innge of a medical group examination. It is considered to interpret it by making use of the CAD. However, when an inter- 
preting doctor makes use of the CAD in tiie conventional practice, whenever the interpreting doctor interprets just a 
sheet of image, diagnostic results of tiie doctor and tfie results of the CAD processing are displayed parallel and the 
interpreting doctor himself/herself successively compares the two results, and when tiie results are inconsislert by the 
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doctor's overlooks of abnormalities or over-interpretations. It is necessary for the doctor to interpret the image again to 
canry out operations such as a correction of the dagnostic results or the like and consequently the work amount of the 
interpreting doctor increases and a time needed for the interpretation also increases. Furthermore, in a method of Inter- 
preting examination Images in a medical group examination by an interpreting doctor, he/she interprets continuously all 
examination images at one time. A CAD using system realizing this interpreting method has not yet been Known. Some 
people demands that It Is convenient to realize such CAD using system. Furlhenmora even in such CAD using system, 
when an interpreting doctor interprets images once more after he/^she compares CAD processing results with Interpret- 
ing results, the Images to re-interpreted are different in the doctor's personal way of thinking. For example, an interpret- 
ing doctor A desires to interpret once more all images concerning overkxjks. and an interpreting doctor B desires to 
interpret once more all images having a contradiction between its own diagnostic results and the CAD processing 
results, and an interpreting doctor C also desires to confirm a type indicated as an abnormality and a discrepancy of Its 
position, and the like. When realizing the CAD using system, it is necessary to flexibly cope with the each interpreting 
doctor's way of thinking in conformity with it. 

[0020] Furthermore, from a viewpoint of personal fikings of interpreting doctors, their requirements are different in 
refemng to the CAD processing results under a certain situation and timing at interpreting examination images. For 
example, the doctor basically desires to interpret ttie images collectively and comes to desire to sometimes refer to the 
CAD processing results even during the interpretation of the images, and the like. At this time, some people demands 
that the CAD using system should have means capable of referring to the CAD processing results whenever the doctor 
desires to refer to them. 

[0021] Furthermore, the center requests a plurality of doctors to interpret the examination images. Then, persons to 
be required a close examination are listed up by comparing the interpretatton results obtained by the plurality of doctors, 
and the images of tiie specified persons are sent from the film storage and the data such as the doctor's interpretation 
results, Information at oral examinations, or ttie like are retrieved and sent from the data storage. Furthermore, tiie 
examination results of persons who are not required a dose examination must be sent to them. As the enonnous Mvork 
amount is entirely canied out by manpower, the work is troublesome. That is, since, in the stage from the entire exam- 
ination of tiie medical group examination to the resultant outputs, there are several works with a great deal of work 
amount such as the two doctors' interpretation, its interpretation results, or the like, a period from the medical examina- 
tton to the output of examination results is prolonged. Accordingly, some people demands that this part is worth using 
the CAD using system. 

SUMMARY OF THE INVENTION 

[0022] In view of the foregoing drawbacks, it is therefore an object of the present inventfon to provide a mednal infor- 
mation processing system tor supporting diagnosis, capable of displaying an original image and a CAD-processed 
result wittiout being interfered therebetween. 

[0023] Another object of the present invention is to provide a medical information processing system capable of 
achieving a continuous and rapid interpretation for entire examination images in a mass sun^ey so that work amount 
and time spent for interpretation by medical doctors are significantiy reduced. 

[0024] Still another ok^ect of tiie present invention is to provide a medical information prwessing system in which 
patients having high probability of abnonnality or normality are extracted by a CAD processing in the mass survey. 
[0025] Still another object of ttie present invention is to provide a medical information processing system capable of 
preparing previous images and typical disease images to be referred to for interpretatton. witiiout involving an operator. 
[0026] Still another object of the present invention is to provide to forther optimize efficiency in torming interpretation 
report by using PACS. 

[0027] The present invention provides a medical information processing system as defined in ttie claims. 
[0028] According to one aspect of the present invention, there is provided a medical information processing system 
comprising: detecting means for detecting location of abnormality from a first medical image in accordance witfi a pre- 
determined algorithm; image fonning means tor torming a second medical image in which a marker indicating the loca- 
tfon of the abnormality is overlapped: and display means tor displaying the first medical image and the second medical 
image, wherein the display means include minrf ication means by which a size of the second medical image is minified, 
and botti the minified second image and tiie first medical image are di^layed simultaneously in a single image frame. 
[0029] According to another aspect of the present invention ttiere is provided a system comprising: diagnosis result 
obtaining means for obtaining a first diagnosis result from a medical image, by detecting at least one of location and 
type of abnonnality according to a predetermined algoritfim; externally inputting means for externally inputting a second 
diagnosis result containing data on at least one of tiie location and type of ttie abnormality; and comparison means for 
comparing at least one of tiie location and type of the abnonnality confirmed from ttie first diagnosis result and at least 
one of ttie location and type of the abnormality confirmed from the second diagnosis result. 
[0030] According to still anottier aspect of the present invention ttiere is provided a system comprising: first diagnosis 
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acquiring means for obtaining first diagnosis results Ijy detecting abnormality in a plurality of medical Images, in accord- 
ance with a predetermined algorithm; externally Inputting means for extenfially inputting second diagnosis results for the 
plurality of medical images; comparison means by which the first diagnosis results and the second diagnosis resutts are 
compared, and the plurality of the medical images are classified into plural categories based on resultant comparison 
between the first and the second diagnosis results; and output means tor outputting a medical image con-esponding to 
at least one of a predetermined category and identifying data thereof among the plurality of medical images. 
[0031] According to the present invention, there is provided a system comprising: storage means for storing a plurality 
of medical images; input means for inputting an examination medical image to be examined; abnormality detection 
means for detecting a type of abnormality in the examination medical image; selection means for selecting the medical 
image whose type of abnormality is same with the examination medical image; and display means for displaying simul- 
taneously the medical inrage selected by the selection means, and the examination medical image. 
[0(^2] According to still another aspect off the present invention, there is provided a system comprising: input means 
for inputting an image; detection means for detecting a type and location of abnormality existent in the image; memory 
means for storing the type and location of abnormality In a fixed sentence form so as to be expressed into a predeter- 
mined sentence structure; and generating means for generating a sentence including at leas one of the type and the 
location of abnormality detected by the detection means, in accordance with the fixed sentence form. 



BRIEF DESCRIPTION OF THE DRAWINGS 



[0033] These and other objects, features and advantages of the present invention will become more apparent from 
the following description of the prefen-ed embodiment taken In conjunction with the accompanying drawings, In which: 

FIG. 1 1s a block diagram showing the entire configuration of PACS. 
FIG. 2 is a block diagram showing construction of the workstation shown in FIG 1 . 
FIG. 3 is a block diagram showing construction of inrrage display manager shown in FIG. 2. 
FIG. 4A and FIG. 4B are an original image and a minified image by image data reduction (minlKcation) unit, respec- 
tively 

FIG. 5 illustrates a display image obtained by display image overiay unit shown in FIG. 2. 

FIG. 6 is a schematic image obtained from schematic data making storage unit shown FIG. 2. 

FIG. 7 illustrates a diagram showing a position (location) of abnormality formed by overlay data forming portion. 

FIG. 8 shows overlay data made by overlay data forming portion shown In FIG. 3. 

FIG. 9 shows a display example at a final stage. 

FIG. 10 shows another display example at a final stage. 

FIG. 1 1 illustrates that data on abnormality are superposed on original image according to the conventional prac- 
tk;e. 

FIG. 12 illustrates an image displayed in the conventional system. 

FIGS. 1 3A and 1 3B show flowcharts to explain the second embodiment according to the present invention. 

FIG. 1 4 shows a flowchart to explain the third embodiment. 

FIG. 15 shows an embodiment having a basic system configuration of the PACS, 

FIG. 16 is a table showing items described on the hearing sheet. 

FIG. 1 7 shows configuration of the image acquisition unit (lA). 

FIG. 1 8 is a table listing information including patient identifying number, accompanied data thereto and data struc- 
ture. 

FIG. 19 shows configuration of database (DB). 

FIG. 20 is a configurational diagram showing the workstation (WS). 

FIG. 21 is a configurational diagram showing the image display manager (WS-IDM). 

FIG. 22 shows relationship between a display color and a bit value of each pixel. 

FIG. 23 is a table showing types of directory data. 

FIG. 24 illustrates a coordinate system of the image. 

FIG. 25 is a table showing data on abnomiality. 

FIGS. 26 through 29 are tables showing abnormality data 

FIG. 30 is a table showing remarks (findings) data. 

FIG. 31 Is a table showing overlay display information created by image display manager (WS-IDM). Indwating a 
doctor's remark (finding). 

FIG. 32 is a table showing overiay display information, indicating a CAD-processed result. 

FIG. 33 is a table showing a part of results, by doctor and CAD, compared and classified by control unit (WS- 

CTRL). 

FIG. 34 IS a set diagram showing a classified comparison result. 
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FIG. 35 is another set-expressed diagram showing a classified corrparison result. 

FIG. 36A and FIG. 36B illustrate Interpreting ways as doctors read (interpret) images, in a usual manner. 

FIG. 37 is a flowchart representing the fourth embodiment. 

FIG. 38 is a table showing types of data included in the examination request information. 
5 FIG. 39 is a configurational diagram showing the workstation (WS). 

FIG. 40 is a table showing the abnormality detecting means selecting data. 

FIG. 41 is a table showing relation between the imaging direction of image obtained from the chest plain X-ray 
image and the relative display position. 
FIG, 42 is a table showing a reading (interpreting) doctor's data. 
10 FIG. 43 is a table showing position data of the normal dissection structure. 

FIG. 44 is a table showing an interpreting r^erence priority order information. 
FIG. 45 is a diagram showing a lung nodule detected by a CAD-processing. 

FIG. 46 is a diagram showing the region of interest (ROI) set by CAD In order to detect interstitial lung disease. 
FIG, 47 is a diagram showing the interstitial lung disease detected by the CAD processing. 
IS FIG. 48 is a figure showing abnomiality regions (Y1 and Y2) determined by the interstitial lung disease result 
obtained by CAD. 

FIG. 49 shows data representing a position (location) of abnomiality. 
FIG. 50 is a table showing the abnormality data. 

FIG. 51 is a table showing overlay display information whereby the position (location) of abnormality is shown. 
20 FIG. 52 is a table showing the data attached to the image. 

FIG. 53 is a diagram showing remarks 8f indings) on the Image input by the reading (interpreting) doctor. 

FIG. 54 is an example of a format o1 the interpreting report which is displayed on a screen of the character display 

unit (WS-CDISP). 

FIG. 55 shows part of doctor's reading (interpreting) report. 
25 FIG. 56 shows a view showing abnormality regions inputted by the reading doctor, expressed in a coordinate sys- 
tem. 

FIG. 57 shows a view showing abnormality regions detected by the CAD, where an image therefor is expressed in 
the coordinate system. 

FIG. 58 and FIG. 59 show an ®(ample for voice input together wwth position input according to the fourth embodi- 
30 ment 

FIG. 60 and FIG. 61 show an example for reading of the characters or the like, according to the fourth embodiment. 
FIGS. 62A - 107 show the fifth and sixth embodiments. 

FIGS. 62A and 62B are flowcharts and configurations for explaining tho gist of the fifth embodiment in the broadest 
sense. 

35 FIGS. 63A and 63B aref lowcharts and configurations for explaining the gist of the sixth embodiment in the broadest 
sense. 

FIG. 64 is tree-type chart showing relationship between the patient ID number, examination ID number and the 
examination data ID number. 

FIGS. 65A and 658 illustrates a case where the examination data ID number is searched from the examined patient 
40 ID number. 

FIGS. 66A and 668 illustrates a case where the examined patient ID number Is searched from the examination data 
ID 

FIGS. 67 through 69 show abnormality data tables with variousf judgment values set according to the first variation 
of the fifth embodiment. 

45 FIGS. 70 through 79 show abnormality data tables in the Images of the examination ID nuntjers 920002 to 920010. 
FIG. 80 shows the classified results of the images of the examination ID numbers 920001 to 020010. 
FIGS. 81, 82. 83 show the created lists A. B, C. respectively. 
FIG. 84 shows a abnormality data table. 

FIG. 85 shows the classified result of the images of the examination ID numbers 930001 to 930010. 
so FIGS. 86. 87. 88 are aeated lists A. B. C. respectively. 

FIG. 89 is a table showing a process for calculating abnormality values in the lung nodUle of an Image whose exam- 
ination ID number is 940001 . 

FIG. 90 is a table showing a process for calculating abnormality values in the interstitial lung disease of an image 
whose examination ID number is 940001. 
S5 FIG. 91 is a table showing abnormality data of the image whose examination ID number is 940001 . 

FIG. 92 is a table showing the classified result of the images of the examination ID numbers 940001 through 
940010. 

FIGS. 93, 94. 95 are created lists A. B. C. respectively, where the classified results falling under case A. case B and 



Patent provided by Sughrue Miop, PLLC - http://www.sughrue.com 



EP0973116A1 



case C are respectively registered in list A. list B and list C. 

FIG. 96 is an at)normality data table for the Image whose examination ID nunr4>er is 920001 . 

FIG. 97 is a table showing the dasstfied results of the images of examination ID numbers 920001 through 920030, 

according to embocfiment no. 6-1 . 

FIGS. 98, 99, 100 are the created lists A, B, C. respectively, where the second classified results falling under case 
A, case B and case C are respectively registered in list A, list B and list C. 

FIG. 101 is the abnormality detailed data table concerning the image of the examination ID number 920002. 
FIG. 102 is a finding data table for the image of the examination ID number 920002. 
FIG. 1 03 shows overlay display data for the doctor's reading. 

FIG. 1 04 shows overlay di^lay data for the CAD-pnocessed result, concerning the examination ID number 920002. 
FIG. 105 is a list showing the abnormality detection result. 

FIG. 1 06 is a table showing the results where the doctor's interpretation results and the CAD-processed results are 
compared and classified. 

FIG, 1 07 illustrates the classification obtained from the comparison result expressed in a set (in a type of Venn dia- 
gram). 

FIG. 108 shows a schematic configuration of a medical archiving communication system (PACS) to describe the 
seventh embodiment. 

FIG. 109 shows system manager 1 shown in Fia 108. 
FIG. 1 10 illustrates constmction of database 3 shown in FIG. 108. 
FIG. 1 1 1 illustrates construction of workstation 4 shown in FIG. 108. 
FIG. 1 12 shows typical disease images. 

FIG. 1 13 is an embodied configuration of the image aquisition units 2A, 2B shown in FIG. 108. 
FIG. 1 14 is a flowchart showing the procedures off judgments of necessity of the additional examination. 
FIG. 1 15 is a detailed flowchart of block A shown in FIG. 114. 
, FIG. 1 16 is a detailed flowchart of block B shown in FIG. 1 1 4. 

FIG. 1 1 7 is a display image plane indicating a case where the next examination is not necessary 

FIG. 119 is a display image plane indicating a case where the next examination is to be conducted. 

FIG. 120 is a table showing an example of the examination request information, according to embodiment no. 7-1. 

FIG. 121 is a table showing an example of the annexed information. 

FIG. 122 is a table showing an example of the interpretation report. 

FIGS. 123-128 show various reference order rules. 

FIG. 1 29 is a table showing an example of the abnormality data. 

FIG. 130 is a table showing an example of he examination histories. 

FIG. 131 is a table showing an embodiment of the annexed information. 

FIG. 132 is a table showing an embodiment of the examination request information. 

FIG. 133 is a table showifing an embodiment of the annexed information. 

FIG. 134 is a table showng an embodiment of the renewed examination histories. 

FIG. 1 35 is a table showing an embodiment of the renewed abnormality data. 

FIG 1 36 is a table where the first and second priority orders of the reference priority order information are written 
in this order. 

FIGS. 137A and 137B are tables showing an embodiment of the annexed Information of the typical disease exam- 
ple Image having the identical type of abnormality (interstitial lung disease) to the uninterpreted image. 
FIG. 138 is a table showing an embodiment of created reference priority order information. 
FIG. 1 39 is a table showing an example in the case where a type of abnormality Is interstitial lung disease. 
FIG. 140 is a table showing an example in the case where the type of abnormality is lung nodule. 
FIG. 141 illustrates embodiment no. 7-4. 

FIG. 142 is a table showing an example of the typical sentences, according to the eighth embodiment. 
FIG. 143 is a table showing an example of the overlay display infomiation. 
FIG. 144 is a table showing an embodiment of the overlay display information. 

FIG. 145 is a table showing an Interpretation report made based on the overlay display information off FIG. 144. 
FIG. 1 46 is a table showing a new interpretation report. 

FIG. 147 is a table showing another new interpretation report to which paragraph "expanding to a wide scope" is 
added. 

FIG. 148 illustrates constmction of workstation according to the eighth entxxliment. 
FIG. 149 illustrates a moving pitch of a cursor displayed on the Image plane. 
FIG. 1 50 shows a figure made in the overlay data forming portion. 

FIG. 151 illustrates an example of the display screen where a type of an-ow in a solid line is used. 

FIG. 152 another example of tiie display screen where other type such as an an^ow in a dotted line can be selec- 
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tively added thereto. 

F(G. 153 shows an example where the minified image Is displayed in an image display unit different from another 
image di^lay unit displaying the original image thereon, according to the first embodiment. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

[00341 Features of the present invention will become apparent in the course of the following descrption of exemplary 
embodiments which are given for illustration of the invention and are not intended to be limiting thereof. Embodiments 
of the present invention will now be described with reference to the drawings. 

Embodiment Na 1 

[0035] Hereinafter, a first embodiment according to the present Invention will be descrtoed with reference to the 
accompanying drawings. Fig. 1 is a block diagram showing the entire configuration of a Picture Archiving Communica- 
tion System (hereinafter referred to as TACS") containing a medical information processing system according to this 
emt)odiment. 

[0036] A network 5 serves as transmission paths for commands and data communicated among components. Optical 
fibers are used as transmission media. The network 5 is herein formed as a ring local area network. Of course, a star 
or other networks will also do. 

[0037] The network 5 is connected with a system manager (SM) 1 . image acquisition apparatuses (I A) 2a. 2b. a data- 
base (DB) 3 for storing medical images acquired by the image aoqusrtion apparatuses 2a, 2b. and workstattons (WS) 
4A, 4B, and this system can respectively be communicated each other with a communication protocol. 
[0038] Furthermore, this network 5 Is connected with an examination order system 7 through a gateway 6. This exam- 
ination order system 7 is located In a room of an examination request department and indicates the request of image 
examination by preparing examination request information. This examination request information contains respective 
Items such as a patient ID number, a patient name, a date of birth, a sex, an examination requesting department, a 
name of examination requesting doctor, an examination modality (an X-ray machine, an X-ray computered tomography 
machine, a magnetic resonance imaging machine, or the like), a region to be examined, a procedure of examination, a 
purpose of examination, a clinical Information, and the like. The Infbrmatton of each item Is manually Inputted into the 
examination order system 7 by the examination requesting doctor. 



(Table 1) 


Patient info 


Patient ID number 




Patient name 




Date of birth of patient 




Sex of patient 
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(Table 1) (continued) 



ExanfL info 


Modality 




Region to be examined 




Procedure of examination 




Name of examination requesting department 




Name of examination requesting doctor 




Date of exanrtination request 




Desired date of examination 




Desired time of examination 




Purpose of examination 




Examination ID 




Clinical information of patient 




Disclosed name of disease 







[0039] This examination request information is transfenred to the system manager 1 after required items have been 
2s finished inputting and appropriate Image acquisition apparatuses 2a. 2b are selected therein in accordance with this 
requesting contents to transfer the information again from the system manager 1 to such selected image acquisition 
apparatuses 2a, 2b. 

[0040] The image acquisition apparatuses 2a, 2b are apparatuses for aquiring a medical image (hereinafter referred 
simplly to as Image") such as an X-ray machine, an X-ray computed tomography machine, a magnetic resonance 
30 imaging machine, a film digitizer, or the like. Additional information as shown In Table 2 is attached to this image, which 
is transfenred to the database 3 to be stored therein. 



(Table 2) 



Examination ID 


Date of Examination 


Number of Sheet of Images 


First Sheet of Image Information 


image number 


Lateral length of pixel 


Longitudinal length of pixel 


Lateral size of matrix 


Longitudinal size of matrix 


Pixel bit length of image 


Data amount 


Imaging Direction 


Second Sheet of Image Information 





[0W1] As shown in Table 2. the additional information or data is prepared per examination unit, including an exami- 
55 nation ID. a date of examination, and ttie Information of each image acquired by such examination. Furttiermore, tfie 
information of image includes an image number, an image size, a data amount, and an imaging direction. 
[0042] After the image aoqusition has be^ completed, ttie system manager 1 creates an exanvnation history from 
the examination request information (data) and ttie additional Information (data). Furthermore, an interpreting doctor 
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prepares an interpretation report of the image and nranually inputs it by using the image acqusition apparatuses 2a. 2b. 
{Terms Interpreting doctor, reading doctor and radiologist are Interchangeably used throughout this 
application.) One example of the examination histories will be hereinafter desaibed. 



(Tabled) 



Patient Info 


Patient ID number 


Patient name 


Patient name 


Date of birth of patient 


Sex of patient 


First Exam. Information 


Examination ID number 


Modality 


Region to be examined 


Procedure of examination 


Name of exam, requesting department 


Name of examination requesting doctor 


Date of examination 


Number of sheet of image 


Second Exam. Information 





[0043] One example of the interpretation report will be hereinafter described. 
[0044] (To be continued) 



(Table 4) 



Information on Patient 


Patient ID number 


Name of patient 


Date of birth of patient 


Sex of patient 


Information on Exam. 


Examination ID number 


Modality 


Region to be examined 


Procedure of examination 


Name of exam, requesting department 


Name of examination requesting doctor 


Date of examination 


Name of interpreting doctor 


Rndings 


Finding 1 


Finding 2 


Finding N 
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(Table 4) (continued) 
Conclusion 



[0045] Terms finding and remarfc am interciwngeabty used in ttiis patent appiication, 

[0046] These examination histories and Interpretation report are transferred to an image storage 4f described below 
to be stored therein. 

[0047] The medical computer-aided diagnosis system according to the present invention is incorporated Into the 
workstations 4A. 4B in this PACS. The workstations 4A, 4B will be hereinafter explained. 
[0048] The workstations 4A, 4B are provided with the following functions: 

(1) A function of displaying examination request information (data), examination histories, an image, an interpreta- 
tion (reading) report, and the like; 

(2) A function of deciding presence or absence of abnormalities of image data by a Computer-Aided Diagnosis 
(CAD), searching its progressing degree, and classifying its type of abnormalities: 

(3) A function of storing CAD processing results; 

(4) A function of displaying CAD processing results; 

(5) A function of inputting findings on the image: and 

(6) Other standard function of the workstation. 

[0049] In order to accomplish the above-mentioned respective functions, the workstations 4A, 48 are constituted as 
shown in Fig. 2. 

[0050] Each device described below is connected with control buses (WS-CBUS) 4k. 4m and an image bus (WS- 
IBUS) 41. These control buses 4k. 4m or the image bus 41 are(is) connected with the network 5 through a network inter- 
face 4j. 

(Control (WS-CTRL)) 

[0051] A control 4a contains a central processing unit (CPU) or a system memory (for example, a semiconductor 
memory device), and controls the operations of the entire workstation and also executes vartous operating processes. 

(System Disk (WS-SD)) 

[0052] A system disk 4b is. for example, a magnetic disk, and stores programs or data descrOsed below and also reads 
out these programs or data when an electric power is switched on to supply them to a system memory within the control 
4a. 

[0053] Stored in the system disk are the program (OS) and abnormality detection means selecting data for operating 
in relation to each part constituting the virorkstation. 

[0054] Herein, the abnormality detecting means denotes an algorithm capable of detecting a specified abnormality, 
and is stored in a CAD processor 4e. As for a typical device off the abnormality detecting means, there are three species 
of abnormality detecting means capable of detecting a pulmonary interstitial disease, abnormality detecting means 
capable of detecting pulmonary nodules, and abnormality detecting means capable of detecting a fine calcification of a 
breast. The abnormality detection means selecting data is a table of a type of image (an examined region, a modality, 
a procedure of examination, an imaging direction) corresponding to a type of abnormalities. The type of abnormalities 
capable of detecting corresponding to the type of images is determined. The above correspondence is based on it. 
[0055] One example of the abnormality detection means select information is shown below. 



(Table 5) 



Examined Region 


Modality 


Examination Procedure 


Imaging Direction 


Types of Detectable 
Abnomality 


Chest 


X-ray 


Plain Radiography 


P-^A 


Interstitial Lung Disease 


Chest 


X-ray 


Plain Radiography 


P->A 


Lung Nodules 


Breast (Mamma) 


X-ray 


Plain Radbgraphy 


(not specified) 


Micro-(3alcification 



[0056] This abnormality detection means selecting information is used when selecting the abnormality detecting 
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means capable of armlizing such image at diagnosing images by the CAD processor 4e. Of course, this abnormality 
detection means selecting data can be rewritten (renewed) and added thereto. 

(Input Unit (WS-INPUT)) 

[0057] An input unit 4c is means for inputting various commands such as an image retrieval or the like by a doctor 
and also manualiy inputting finding data after he/she observes the image, and for example, a keyboard or a mouse is 
used. Herein, the finding data consists of a type of abnormality, its position (XY-coordlnates of an image matrix), a 
degree of abnonnality. or the like. Incidentally, these finding data are summarized in a finding data table for each type 
of abnormality. This finding data table is identical to the abnonnality data table which is outputted as a result of diagno- 
sis in the below-mentioned CAD processor 4e in items of its contents. 

[0058] Herein, one example of a procedure for inputting the finding data will simply be described. Firet, a cursor is 
doubly displayed on the original image conresponding to movements of a mousa The cursor is put upon the image 
showing abnormalities by moving the mouse. When a left button of the mouse is clicked, the position is recognized. Inci- 
dentally, when the input position is erroneous, the system acknowledges that such input position has not be inputted by 
clicking an inside button of the nrwuse. It is fairiy ftmrable in operating the system that a move pitch of the cursor is set 
as about 32 pixels when an image matrix is 2,048 x 2.048 pixels. The system synchronizes with the dick of the left but- 
ton of the mouse to display a message, for example, "input the type of abnormality" on the screen. By inputting from 
keys on a keyboard In reply to this message, input the type of abnormality such as "pulmonary Interstitial disease" or 
the like. The system synchronizes with this input completion to display a message, tor example, "input the degree of 
abnormality" on the screen. By inputting from keys on a keyboard in reply to this message, input the degree of abnor- 
mality, for example, as a level of 1 to 10 (10 is such a condition that abnormafity makes the worst). The position, type, 
and degree of abnormality are summarized in the finding data table together with a reference number, an examinatiori 
ID number, and an image number, and such information Is transferred to the image storage 4f described below and 
stored therein. 

(Character Display (WS-CDISP)) 

[0059] A character display 4d is a device for displaying mainly characters such as interpretation (reading) reports etc. . 
and for example, a CRT (Cathode Ray Tube) display, a liquid crystal panel display, or the like is used. 

( CAD Processor (WS-CADP) > 

[0060] A CAD processor 4e Is provkled with a fonction of a Computer-Aided Diagnosis, receves an instruction of acti- 
vation from the control 4a, peribrms the CAD processing (diagnosis processing) on Inputted images by this function, 
and aeates the abnonmality data table finally. Hereinafter, one example of the abnormality data table will be shown. 



(Table 6) 

Reference number 
Examination ID number 
Image number 
Type of abnormality 

Central position of abnormality on image (lateral coordinate, longitudinal coordinate) 
Degree of abnormality 

[0061] As shown In Table 6. the abnormality data table consists of respective items of a reference number, an exam- 
inatfon ID number, a type of abnormality, a central position of abnormality on an image, and a degree of abnormality. 
[0062] The CAD processor 4e contains the plural species of abnormality detecting means as described above. That 
is. as a typical embodiment, there are provided: (a) means for detecting a shadow of a pulmonary interstitial disease in 
a front side image of a chest plain X-ray image; (b) means for detecting a shadow of a pulmonary nodules in a front side 
image of a chest plain X-ray image; and (c) means for detecting a shadow of a fine calcification of a breast in a breast 
X-ray image Incidentally, algorithms of detecting abnormalities in each abnormality detecting means are detailed in 
respective literatures of Japanese Patent Application Laid-Open No. 2-185240. Japanese Patent Application Laid-Open 
No. 2-250180. Japanese Patent Application Uid-Open No. 2-152443, Japanese P&tent Applicatfon l^W-Open No. 2- 
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125675. and the (ike. The detailed description therefor is omitted. 

[0063] A digital image (hereinafter referred to as an "original imageT is transferred from the database 3 to the CAD 
processor 4e. Furthermore, under an instruction of the control 4a. information of the type of abnormality corresponding 
to such original image of the abnormality detection means selecting data of the system disk 4b is transferred. Any 
abnormality detecting means is selected corresponding to the type of this abnormality. The original image is analyzed 
by the selected abnormality detecting means. If there is an abnormality, the central position on an image of this abnor- 
mality (XY-coordinates of an image matrix) and the degree of the abnormality are acquired. The above-mentioned 
abnormality data table containing these position and degree of abnormality is created by the CAD processor 4e. The 
abnormality data table Is transferred to the belowHfnentioned Image storage 4f and stored therein. 

< Image Storage (WS-IM) > 

[0064] An Image storage 4f Is, for example, a magnetic disk, and a device for temporarily storing examination request 
Information derived from the examination order system 7, examination histories, an interpretation (reading) report, addi- 
tional information to image, original image data, overlay display information (image data showing abnormalities), an 
abnomfiality data table, and a finding data table. 

< Image Frame Memory (WS-IFM) ) 

[0065] An image frame memory 4g is. for example, a semiconductor memory and a device for temporarily storing at 
least a she^ of original Image to be Interpreted which is transferred from the database 3. 

(Image Display (WS-IDISP)) 

[0066] An image display 4i is. for example, a color CRT display and a plurality of image displays, herein four image 

displays, are prepared. This image display 41 is a device for displaying mainly an image. 

[0067] It shall be appreciated that respective image display units may present different resolutions and so on. 

< Image Data Reduction Unit (WS-RED)} 

[0068] An image data reduction unit 4p receives the original image of the image frame memory 4g tiirough the image 
bus 41 , and for example, this is minified to a reduced image of 1/8. That is. as shown in Figs. 4A, 4B, if an image matrix 
size of the original image Is a x b pixels, the reduced image is an image matrix size of a/8 x b/B. For example, if the 
image matrix size of the original image is 2.048 x 2.048 pixels, the reduced image consists of 256 x 256 fimage 
matrixes. This reduction processing is. for example, af leveling reduction filter processing. The leveling reduction filter 
processing is tfiat the original image is partitioned into a plurality of minute areas of 8 x 8 pixels and a simplified average 
or a weighted average of a pixel value in each area is defined as a pixel value of one pixel of the reduced image. Of 
course, the other reduction processing may be adopted. The reduced image created by the image data reduction unit 
4p Is sent to a display image data overlay unit 4q as described later. 

[0069] It shall be appreciated that tiiough we have described minlficatlon of 1/8 for the minified image over the original 
Image, a minifying factor may be 1/1 . 

< Display Image Data Overlay Unit (WS-OV) > 

[0070] A display image data overiay unit 4q synthesizes the original image to be interpreted which is stored in the 
image storage 4f witti the reduced image of this original image which is aeated by the image data reduction unit 4p to 
generate a sheet of composite image to be displayed. Here, a composite processing will be explained with reference to 
Fig. 5. 

[0071 ] Referring to FIG. 5. if a pixel matrix size of the original image is a x b pixels, the pixel matrix size of the reduced 
Image is a/8 x b/8 pixels as described above. A part of ttie original image is completely substituted for pixels of the 
reduced image. Herein, when a left upper corner of the original image is the origin to locate the reduced Image to a right 
upper part of the original image, a substituted area is specified by four points (a-a/8. 0). (a. 0). (a, b/8). (a-a/8. b/8) in 
the original image. Thus, the original image is synthesized with the reduced Image to create a synthetic Image. This 
synthetic image is transfen^ed to tiie image storage 4f and stored therein. 

< Schema Data Making Storage (WS-SMMK)> 

[0072] A schema data (or schematic diagram data) making storage 4r inputs an image, digitizes it to abstract an out- 
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line of lungs or ribs, niakes a schema (or schematic) image (contour image) as shown in Fig. 6, and stores it. 
[0073] For example, if a threshold value of digitization Is 512, and when a pixel value i (x.y) of a certain pixel (x,y) is 
the threshold value or greater, such pixel value is sul)stituted for 1 023. Furthermore, the pixel value f (x,y) of the certain 
pixel (x,y) less than the threshold value, such pixel value is substituted for 0, After this schema image is minified in 
the image data reduction unit 4p. it is sent to the display image data overlay unit 4q to synthesize it with the original 
image instead of the above-mentioned reduced image, thereby creating a synthetic imaga In order to select as to 
whether the synthetic image is an image in which the original image is synthesized with the reduced image of this orig- 
inal image, or the synthetic image is an image in which the original image is synthesized with the reduced image of this 
schema Image, an operator will set its selection from the input unit 4c. 

(Overlay Display Information Maker (WS-OVMf<)} 

[0074] An overlay display information maker 4n inputs either the abnormality data table or the finding data table con- 
cerning such original image stored in the image storage 4t the overlay display infonmation maker 4n makes overiay dis- 
play information as shown in the following Table 7: 

(Table 7) 

Examination ID 
image Number 
Reference Number 
Type of Graphic 
Size of Graphic 

Coordinates (Central Position of Abnonmality) 
Display Color 
Type of Abnormality 
Degree of Abnormality 



[0075] In this overlay display information, information of each of items of a type of a graphic, a size of a graphic, and 
a display color is added to the Items of the abnormality data table and the finding data tabla These additional informa- 
tion is required to superimpose information of abnormalities on the synthetic images, and as shown in Fig. 7. the con- 
tents have beforehand been set. The type of a graphic Indicates a graphic for showing the position of abnormality on 
the image, and for example, this is information indicating to display as a shape of an arrow. 
[0076] The size of a graphic is information indicating that such arrow should be shown in a size to be received within 
a scope of, for example, 32 x 32 pixels. The display color is one of such an-ow, and information indicating that such 
arrow should be shown in white. Here, the coordinates of overlay display information are that the coordinates indicating 
a central position of the abnormality which is written into the abnormality data table are converted into coordinates on 
the reduced image of the sysnthetic image. The overiay display information is tiansfen-ed to the image storage 4d to be 
once stored therein. 

( Image Display Manager (WS-IDM) ) 

[0077] An image display manager 4h is a control concerning a display such as an original image etc. and constructed 
as shown in Rg. 3. 

[0078] An image memory 42 receives the synthetic image stored in the image storage 4f through the image bus 41 to 
be stored therein. The image memory 42 has storage capacity of, for example. 2.048 x 2.048 x 10 bits so as to store at 
least a sheet of synthetic image. 

[0079] Information of a display mode set by the input unit 4c (a mode displaying only an aiginal image, a mode dis- 
playing only abnormality information, a mode displaying synthetic images of the original image and the abnormality 
image on one screen) and information specifying the image display 4i for use in the display are supplied to a control unit 
40 through the control bus 4k. 

[0080] Furthermore, the overiay display infomialion is supplied from the image storage 4d to the control unit 40. An 
overlay data aeator 41 receives the overiay display infonmalion from the control unit 40 and creates overiay data to dis- 
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play the abnormality information (the information showing a type, a position, and a degree) on the reduced image based 
on this overlay display infonmation. These overlay data are temporarily stored in one overlay memory 43a. 
[0081 J In this connectfon. the other overlay memory 43b is a memory for storing data of a cursor displayed on a dis- 
play screen in response to movements of a mouse. An overlay unit 44 creates an overlay di^lay image by superinpos- 
ing the overlay data on the synthetic image. This overlay display image is displayed on the set image display 4i through 
display memories 45 and D/A converters 46 corresponding to the image display 4i con-esponding to Information speci- 
fying the image display 4i for use in a display set by the input unit 4c. 

[0082] Next operations according to this embodiment having such configuration will be described. 
(1) Request of Examination 

1 -1 ) The examination request infonmation inputted through the examination order system 7 is transferred to the sys- 
tem manager 1. One exanrple of this examination request information is shown in table 8 as described below. (To 
be continued) 



(Tabled) 



Patient ID Number 


870802 


Patient IMame 


E. Suzuki 


Dateof Birth of Patient 


August 6,1952 


Sex of Patient 


Male 


Modality 


X-ray 


Region to be Examined 


Chest 


Examination Procedure 


Plain Radiography 


Name of Exam. Requesting Dept 


Department of Internal Medicine 


Name of Exam. Requesting Doctor 


T. Yamada 


Date of Exanfifnation Request 


May 10, 1992 


Desired Date of Examination 


May 10, 1992 


Desired Time of Examination 


14:00 


Purpose of Examination 




Examination ID 




Clinical Information of Patient 




Disclosed Name of Disease 








Examination ID 


108801 



1- 2) Next, such examination request information is transferred to an image acqusition apparatus 2a or 2b which is 
an X-ray macNne according to the modality. 

(2) An examination is carried out in the image acquisition apparatus to produce images. 

2- 1) An operator reads contents of the examination request information and a radiography is carried out as indi- 
cated there to produce images. These images are assigned image numbers in sequence of their production order. 
2-2) When the image aoquisition is finished, the additional information as shown in Table 9 is prepared by the image 
acqusition apparatus 2a. 



(Table 9) 



Examination ID 


108801 


Date of Examination 


May 10. 1952 
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(Table 9) (continued) 



Number of Sheet of image 


2 


Image Number 


1 


Lateral Length of Pixel 


0.06 cm 


Longitudinal Length of Pixel 


0.06 cm 


Lateral Size of Matrix 


2048 


Longitudinal Size of Matrix 


2048 


Pixel Bit Length of Image 


10 


Amount of Data 


5MB 


Imaging Direction 


P^A 



This additional information is transferred to the database 3 together with the image to be stored therein and will 
stand by until it is read out to Interpret It 

(3) The examination histories of such patient, the past interpretation report, and the examination request informa- 
tion are prepared by the system manager 1 and transferred to the workstations 4A, 4B to be stored in the system 
memories. 

Next, interpreting operations will commence. 

(4) A readout demand of the image to be interpreted is sent from the worl^tation 4A to the database 3. Such image 
(including the additional infonnation) is sent back to the workstation 4A together with the examination histories of 
such patient, the past interpretation report and the examination request Information to be stored in the image stor- 
age 4f. 

(5) The abnormality data table and the finding data table are created. 

One of the abnormality data table and the finding data table Is created. The abnormality data table is created 
by the CAD processor 4e. On the other hand, such image is displayed on the image display 41 and observed by an 
operator to input the results through the Input unit 4c. Consequently, the finding data table Is created. 

One example of the abnormality data table is shown in Table 10. Furthermore, one example of the finding data 
table is shown in Table 1 1 . 



(Table 10) 



RefNa 


Exam. ID Number 


Image No. 


Type of Abnormality 


Central Position of 
Abnormality on 
Image 


Degree of Abnormal- 
ity 


1 


108807 




Interstitial lung dis- 
ease 


(350. 1350)* 


9 


2 


108801 




Interstitial lung dis- 
ease 


(400. 1500) 


8 


3 


103541 




Interstitial lung dis- 
ease 


(300, 1500) 


8 


4 


103541 




Interstitail lung dis- 
ease 


(1600. 1300) 


8 


5 


100902 




Interstitial lung dis- 
ease 


(350. 1350) 


7 


6 


100902 




Interstitial lung dis- 
ease 


(400. 1500) 


7 


7 


100902 




Interstital lung dis- 
ease 


(1500. 300) 


1 cm 



'(abscissa, ordinate) 
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(To be continued) 



(Table 11) 



Examination ID Number 


108801 


Image Number 


1 


ReferencA Numhor 


1 


Type of Abnormality 


Interstitial Lung Disease 


Central Position o1 Abnormality on Image (Lateral Coordinate, Longitudinal Coordinate) 


(350, 1350) 


Degree of Abnormality 


9 


Reference Number 


2 


Type of Abnormality 


Interstitial Lung Disease 


Central Position of Abnormality on Image (Lateral Coordinate, Longitudinal Coordinate) 


(400. 1500) 


Degree of Abnormality 


8 



TTiese abnormality data table or finding data table will be sent to the image storage 4f to be stored therein. 

(6) Creation of Display Image 

The original image is read out off the database 3 and stored in the image storage 4f It is transferred to the 
image data reduction unit 4p and the display image overlay unit 4q. The original image is minified at a predeter- 
mined reduction rate, herein at 1/8, by ttie image data reduction unit 4p. This reduced image is sent to the display 
image overlay unit 4q and syntiiesized into tfie original image and a sheet of synthetic image therein. As this syn- 
thesis processing is above-mentioned, the description is omitted. 

Of course, this synthetic Image can be made instead of the above-mentioned reduced image. Namely, ttie 
schema image made by the schema data making storage 4r can be reduced by the image data reduction unit 4p 
to create a reduced image which is synthesized with the original image to create the syrthetic image. 

(7) Creation of Overlay Display Information 

The abnomiality data table (or the finding data table) is supplied from the image storage 4f to the overlay dis- 
play information maker 4n to make tiie overlay display information based on tills abnormality data table In a graphic 
to be displayed as described above, the type thereof is an an-owheaded real line and a size thereof is 32 x 32 pixels 
and a display color is white. 

Furthermore, as the position of abnormality in the abnormality data table is determined with coordinates 
defined by a coordinate system of the original image, it is necessary to transform these coordinates into coordi- 
nates on tiie reduced image of a display Image. For example, if a pixel mato-ix size of ttie original image is 2048 x 
2048 pixels and the position of abnormality in tiie abnormality data table in this coordinate system is (a.B). ttie coor- 
dinate of such position of abnormality is converted into coordinates (2048 - 2046/8 + a/8, B/8). At the display, the 
information of abnomiality Is supperimposed on the reduced Image by this coordinate transformation to be dis- 
played. One example of the overlay display information created based on the abnormality data table as shown in 
Table 10 Is shown in Table 12 described below. (To be continued) 



(Table 12) 



Examination ID 


108801 


Image Number 


1 


Reference Number 


1 


Type of Graphic 


Arrowheaded Real Line 


Size of Graphic 


32 dots 


Coordinates 


(350.1350) 


Display Color 


White 


Type of Abnormality 


Interstitial Lung Disease 
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(Table 12) (continued) 



Decree of Abnormality 


9 


Roforonco MiimHor 


o 
c 


Type of Graphic 


Arrowheaded Real Line 


Size of Graphic 


32 dots 


Coordinates 


(400. 1500) 


Type ofAbnormality 


interstitial Lung Disease 


Degree of Abnormality 


8 



Specifically, as for the abnormality of the examination ID 10880. the image number 1. and the reference 
number 1. the abnormality data table of Table 10 has data such as the position of abnormality on the Image 
(350.1350), the degree of an abnormality "S", and the type of abnormality "pulmonary interstitial disease*. Accord- 
ing to this information, the position of abnormality ( 1 835. 1 68) which is obtained as a result of the coordination trans- 
formation, the degree of abnormality "9". the type of abnormality "interstitial lung disease", the type of graphic 
"arrowheaded real (solid) line", and the display color "white" are written into the data number 1 in the overlay display 
information. 

Similarly, the position of abnonnality (1 841 , 1 87). the degree of abnormality "8", the type of abnormality "inter- 
stitial lung disease", the type of graphic "arrowheaded real (solid) line", and the display color ^vhite" are written into 
the data number 2. Incidentally, when the result of coordinate conversion contains a decimal point or less, it is 
rounded to the nearest whole number to be treated as an integer value. The thus-created overlay display informa- 
tion is stored in the image storage 4f. 

(8) Display of Image 

At displaying the images, under an indication of the control 4a, the synthetic image created by the display 
image overlay unit 4q is transfered from the image storage 4f to the image memory 42 of the image display man- 
ager 4h to be stored therein. Furthermore, under an indication of the control, the overlay display information cre- 
ated by the overlay display information maker 4n is sent from the image storage 4f to the overlay data creator 41 
through the control unit 40 in the image display manager 4h. Furthermore, a display mode inputted from the input 
unit 4c (herein, this is a display mode by superinposing the overlay image on the original image) and information 
specifying the image display 4i to be displayed are supplied to the control unit 40. The following overlay data are 
created based on the overlay display information in the overlay data creator 41 and stored in the overlay memory 
43a. For example, in the abnormalities of the data number 1 , as shown in Fig. 8, bits are erected in an an-owheaded 
shape in coordinates (1835,168) of the overlay memory 43a, and in the character display of the degree of abnor- 
mality -g- and the type of abnormality "interstitial lung disease", bits are erected in a character shape on the overlay 
memory 43a using a character font in the control 4a Similarly in the abnormalities of the data number 2, bits are 
erected in an arrowheaded shape in coordinates (1841.187) of the overlay memory, and in the character display of 
the degree of abnormality "8" and the type of abnormality "interstitial lung disease", bits are erected in a character 
shape on the overlay memory 43a using a character font in the control 4a. 

This overlay data are supplied to the overlay unit 44 together with the synthetic image of the image memory 42 
and superimposed thereon to be displayed in the image display 4i ^edfled by the input unit 4c. This display exam- 
ple is shown in Fig. 9. Incidentally, when images in which the schema image is synthesized with the original image 
are displayed instead of the reduced image, its displ^ example is shown in Fig. 10. 

(9) Processing after Interpretation. 

An interpreting doctor interprets the images which are superimposed on the overlay data, and inputs its inter- 
pretation results from the input unit 4c to create the Interpretation report. This interpretation report is transfen-ed to 
the image storage 4f to be stored therein. Furthermore, the interpretation report is transferred from the image stor- 
age 4f to the database 3 through the system manager 1 to be stored therein. 

[0083] Asdescribed above, in this embodiment, since the reduced Image (or the reduced image of the schema Image) 
Is disposed in a part of the original image and the information of abnormalties is displayed on this reduced image, even 
if an object of the original image is interfered with the information of abnormalities, the Image never disappears and a 
doctor can interpret the original image on one saeen referring to the infcrmatfon of abnormalities. Accordingly, it 
becomes unnecessary to change between the display of only the original image and the display of the image which 
superimposes the information of abnormafities on the original Image, thereby enhancing operator productivity. 
[0084] The present invention is not limited to the above-mentioned embodiments, which can be variously changed to 
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execute the other embodiments. For example, in a technique for use in the above-mentioned desaiption, when creating 
from the original image to the reduced image, the original image is smoothened by the reduction filter processing. The 
other technique can be utilized. For example, the reduced image can be aeated by sampling scattered pixels of the 
original Image. 

[0085] Furthermore, in the above-mentioned description, a sheet of reduced (minified) image is superimposed on the 
original image, however a plurality of sheets of reduced image can be superimposed thereon each type of abnormality. 
Furthermore, in the above-mentioned description, a shape or display color of a graphic of the overlay data is one type 
only, however the shape or display color of a graphic can be changed for each type of abnormality 
[0086] Furthermore, in the above-mentioned description, a position of abnormality shown with an arrow, however 
the other graphics such as a round, a square, or the like can be used. Furthemiore, in the above-mentioned description, 
the CAD processor is provided with three types of abnormality detecting means, however the other types of abnormality 
detecting means can be used and also the type of image to which ttie abnormality detecting means is applied is not 
limited. 

[0087] Furthermore, in tfie schema (schematic) data making storage, each pixel value of tiie schema (schematic) 
image is digitized at a threshoW value to make the schema (schematic) image, however it may also be made by contour 
extracting means such as a contour line tracing tomography machine etc. 

[0088] Furthermore, in the above-mentioned description, the schema image is made from the original image at dis- 
playing the Image, however the schema image has beforehand been made before displaying the image to be stored in 
a system disk so that it may be used at displaying tiie image. 

[0089] Referring to FIG. 153. It shall be appreciated that the reduced (minified) image (in which the arrow is superim- 
posed) may be displayed in other display unit ttian that displaying the original image. For example, the original image is 
displayed in image display unit (WS-IDISP-1) 4i. while tiie reduced image, in which the arrow is superinposed, is dis- 
played in another image display unit (WS-lDISP-1) 41. 

[0090] In tiie first embodiment according to tiie present invention, a medical Information processing system com- 
prises: means for Inputting an image; means for inputting a position of an abnormal spot containing said image; means 
for making a reduced image by reducing (minifying) said image; means for creating a synthetic image by synthesizing 
said image with said reduced image: means for creating a display image by superimposing a graphic showing said 
abnormal spot on said reduced image of said synthetic image based on said position; and means for displaying said 
display image. 

[0091] The graphic showing the abnormal spot Is superimposed on tiie reduced image of the synthetic image which 
synthesizes the image with ttie reduced image to display it whereby even if an object of tiie image is interfered with the 
abnormal graphic, the object never disappears, and the original image can be Interpreted referring to information of 
abnormalities on one screen. Accordingly, it is possible to provide the medical infomiation processing system in which 
it becomes unnecessary to change between the display of only the original image and tiie display of the image which 
superimposes tiie information of abnormalities on ttie original image unlike the prior art. thereby enhancing operator 
productivity. 

Embodiment No. 2 & Embodiment 3 

[0092] Hereinafter, other pretended embodiments of the present Invention will be explained witii reference to the 
accompanying drawings. In this embodiments, an embodiment of performing a CAD by using a PACS will be described, 
and first of all, the gist of the present Invention will be described, and next a system configuration of the PACS will be 
described, and finally a procedure in the case of interpreting by using the system of the present invention will be 
described in detail. The descriptions on tiie system configuration of the PACS and after will be made witti reference to 
an embodiment of interpreting a chest X-ray image for a lung cancer screening examination. 
[0093] Figs. 13A. 13Band 14areflowchartsfor explaining the gist of the present invention. Figs. 13Aand l3Bshows 
the gist of a second embodiment and Rg. 1 4 shows the gist of a third embodiment. Fig. 13A shows the gist having ttie 
broadest sense in tfie second embodiment. This is the embodiment in which a plurality of diagnostic results having one 
or more diagnostic data obtained by a medical group examination or mass survey or ttie like within a medical informa- 
tion processing system exist, and these diagnostic results are to be compared or classified. Assuming that a plurality of 
diagnostic results are diagnostic results A and diagnostic results B. these results are first compared and classified In 
each diagnostic Information. Next, a great amount of diagnostic infonmation Is classified in a listing fomri etc. and 
selected and outputted to report. The disgnostic results A and ttie diagnostic results B may be diagnostic results 
obtained by ttie plurality of doctors and may be CAD processing (diagnostic) results and doctors' interpretation (diag- 
nostic reading) results. The latter case will be explained in Fig. 13B and herein ttie former case will be explained. That 
is, doctors A and B interpret images in a workstation WS to obtain interpretation results, which are inputted into a data- 
base DB, and then a great amount of diagnostic tnformatfon inputted is compared and classified to be divided into two 
categories in which a dose examination is necessary or unnecessary. When the diagnostic information is classified ttiat 
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a close examination is necessary, identification information of its medical e)»mination data or the medical examination 
data and diagnostic Information and information relating to the medical examination data are outputted. On the other 
hand, when the diagnostic information is classified that a close examination is unnecessary, the identification informa- 
tion of the medical examination data and the doctor's diagnostic information are outputted. 
[0094] Fig. 13B is a case of comparing the CAD processing results with the doctor's diagnostic results. Information 
concerning a hearing examination or disease histories is inputted from a hearing Information Input unit HI and image 
data of a certain type of medical examination data are inputted from an image acquisition unit lA. In the database DB 
into which these are inputted, each image data is CAD-processed to detect an abnomiality to obtain the result to create 
an abnormality data tabia On the other hand, the image data, the hearing information, or the like are sent from the data- 
base DB to the workstation WS to display the image data therein and a doctor Interprets the lmage& An Interpreting 
doctor creates a finding data table which is interpretation results for each image data to be input therein. When the doc- 
tor finishes interpreting the images, he/she compares tills finding data table with the abnormality data table which is the 
CAD processing results and can classify it to create an abnormality detecting result list which is its results, in order to 
output it for each classification. When the doctor re-interprets the images, he/she outputs (including a display) his/her 
own favorable classification to complete finding data, and sends the results from the workstation WS to the database 
DB to be registered therein. The interpretation In the medical group examination is cam'ed out by two or more doctors, 
and this completed finding data is sent to the database DB in at least two sets. After a plurality of interpretations are 
inputted Into the database DB, this system operates as described in Rg. 13A described above. 
[0095] Fig. 14 shows the gist of the third invention. Information concerning an oral examination or disese historic is 
inputted from the hearing information input unit HI, and image data which are a certain type of medical examination data 
are inputted from the image acqusition unit lA. In the database DB where these image date are Input, each image data 
is CAD-processed to detect an abnormality before a doctor interprets the image data, in order to create the abnormality 
data table which is its results. On the other hand, based on the Image data, the hearing Information, or the like which is 
sent from tiie database DB to the workstation WS, a doctor interprets the images. In tills case, tiie CAD processing 
results created previously can be referred to. Then, materials referred at this interpretation are registered in a CAD 
processing result reference list, and when tiie finding data table is compared with the abnormality data table to classify 
it after the doctor's interpretation, the refen^ed materials are removed to compare each other. The tables are compared 
and classified to create an abnomiality detecting result list which is its results. Thereafter, tiie system operates in the 
same manner as Fig. 13B. 

[0096] In this connection, a broken line in the figure shows that the part is not principal in the present invention. Also, 
the CAD processing has been explained in the embodiment operating by the database DB. however, image data etc. 
can be sent to the workstation WS to perform the CAD processing therein. 

[0097] Next, Fig. 15 shows an embodiment having a basic system configuration of the PACS. This system is con- 
structed of the following units (subsystem): 

1) Hearing information input unit(HI); 

2) Image acquisition unit (lA); 

3) Database (DB); and 

4) Workstation (WS). 

[0098] The hearing information input unit (HI) is a device for Inputting hearing Inforaiation or disease hitories which 
are obtained by an aal examination to examined persons. 

[0099] The image acquisition unit (lA) is a medical image acqusition unit for the PACS such as an X-ray machine, an 
X-ray CT machine, an MRI machine, a film digitizer or the like. Herein, it is defined as an X-ray machine which is placed 
on a medical examination car 

[01 00] The database (DB) is used for storing various data to be produced in operations of the medical examination. 
[01 01 ] The workstation ( WS) appropriately processes digital images etc. sent from the database (DB) or the image 
acquisition unit (lA) to obtain desired results to display or output them. In this embodiment, the wrkstation is used for 
interpreting radiographed images. 

[01 02] Communicatfons among these four types of units are earned out by using a data memory medium capable of 
carrying and rewriting, such as an optical magnetic dsk or the like. 

[0103] Next, a functton of each unit (subsystem) and its configura-tional element will be described. 
[0104] A nfialn function and operation of the hearing information input unit (HI) will be descrfoed. 

To display a hearing sheet (questioning contents for a person to be examined). Items described on the hearing 
sheet are shown in Fig. 16. 
* To input identification information of a person to be examined (person ID number). 

To Input and display responses of an examined person to the items described In the questioning sheet. 
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* To write inputted responses (hearing information) and the klentif Ication Information of an examined peison into the 
optical magnetic disk. 

[0105] The hearing information input unit (HI) can readily be realized by adapting a personal computer to be obtained 
5 in the market. As the configuration has no connection with the gist of the present invention, the description is omitted. 
[0106] As the image acquisition unit (lA), first a main function is described 

* To acquire digital image data. 

* To input the Identification information of a person to be examined (person ID number). 
10 * To Input and display Information attached to an examination and an Image 

To write the identification information of an examined person, image data, and information attached to an examina- 
tion and an image Into the optical magn^c disk. 

[0107] As for ttie image acquisition (lA). a configuration element and its function will be described. The configuration 
IS of ttie image acquisition unit (lA) is shown in Fig. 1 7. 

Control Unit()A-CTRL) 

[0108] A control unit contains a central processing unit (CPU) or system memories (namely, semiconductor memory) 
20 etc. and controls operations of ttie entire image acqusition unit. 

System Dlsk(IA-SD) 

[0109] This is a magnetic disk and stores a program or data, such as: 

25 

(a) a program for operating an image acquisition unit; 

(b) identification information of a person to be examined; and 

(c) information attached to an examination and an Image. 

30 This program is read out when the Image acquisition unit is turned on and written into system memories wlttiin ttie con- 
trol unit (lA-CTRL). Furttiermore. ttie idetif Ication Information of an examined person and the information attached to an 
examination and an image are stored for each examination and a type of ttie data is shown in Rg, 18 together with a 
data configuration. 

35 X-ray Generator (lA XGEN) 

[01 1 0] This is a device for generating X-rays to irradiate a person to be exposed. 

X-ray Imaging Unit (lA-IMG) 

40 

[0111] This Is a device for detecting X-rays transmitted ttirough a person to be exposed, converting ttiem into electric 
signals, and digitizing ttie signals to obtain a digital image. This contains an image intensifier. a TV camera, an ana- 
log/digital converter and ttie like. 

45 Input Unit (lA-INPUT) 

[01 1 2] This Is means for inputting information such as commands etc. by an operator and uses a keyboard, a mouse, 
a touch screen or the like. 

50 Display Unn(IA-DISP) 

[Oil 3] This Is a device for displaying information inputted by an operator and digital image acquired, and uses a CRT 
display, a liquid crystal panel display or ttie fika 

55 Image Data Unit (lA-IM) 

[0114] This is a dei^ice for temporarily storing digital image data acquired by ttie X-r^ imaging unit (for example, a 
semiconductor memory or a magnetic disk) 
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Optical Rlbgnetfc Disk Drive (IA*MODD) 

[01 1 5] This is a device for reading data out of portable optical magnetic disk or writing data thereinto. 
Control Bus (lA CBUS) 

[01 1 6] This is a transmission path of various control information within the image acquisition unit. 
Ini^e Bus(IA>IBUS) 

[01 1 7] This is a transmission path of image data ¥vithin the image acquisition unit 
[01 18] Also, a dock (not shown in Rg. 1 8) is Integral with the image acquisition unit. 
[0119] As for the database (DB). first a main function and operations wilt be explained. 

* The database (DB) stores idetification infornration of an examined person, hearing information, image data, and 
infamation attached to examination information and an image. 

* The database (DB) stores findings which are doctors' interpretation results. 

• The database (DB) detects images having doubtful abnormalities from image data. 

• The database (DB) can 

write various data into the portable optical magnetic disk or read them out of it. 

[0120] A configuration element and a function in the database (DB) will be described. The configuration of the data- 
base (DB) is shown in Fig. 19. 

Control Unit (DB-CTRL) 

[01 21 ] This includes a central processing unit (CPU), system memories (namely, semiconductor memory) or the like 
and controls operatfons of the entire database. 

System Disk (DB-SD) 

[01 22] This is a magnetic disk and stores a program for operating the database or the like. This program etc. is read 
out when an electric power of ttie database is turned on and written into system memories within ttie control unit (DB- 
CTRL). 

Search UnH (DB-SRCH) 

[01 23] This searches information conforming to a given keyword according to an instruction from the control unit (DB- 
CTRL). and is a device having a function of replying searched results to the control unit (DB-CTRL). The search unit 
includes a directory of information stored in the database and searching means. A magnetic disk is used as storing 
means of tiie directory. 

Data Storing UnH (BD-STRQ) 

[01 24] This is a devfoe for storing kJentif ication information of an examined person, hearing information, image data, 
informatfon attached to examination information and an image, and a doctor's findings for a long-termed period, and an 
optical disk is used as the data storing unit (BD-STRG). 

Image Processing Unit (DB-IP) 

[0125] This (S means for detecting abnormalities from an image, and when image data and data indicating a type of 
abnormalities (disease) which is an object to be detected are inputted, ttie image processing unit (DB-IP) detects the 
type of abnormalities and outputs a position and a degree of abnormalities, and Includes a plurality of types of abnor- 
mality detecting means. That is: 

(a) means for detecting shadows of pulmonary nodules in a front skle intage in a chest plain X-ray image; and 

(b) means for detecting shadows of interstitial lung c&sease in a front side image in a chest X-ray image. 
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[0126J These detecting means aredisclosed in the below- mentioned literatures :(1) Japanese Patent Application Laid- 
Open Na 2-185240(2); Japanese Patent Application Laid-Open No. 2-152443(3); Japanese Patent Application Laid- 
Open No. M25675. 

5 Input Unit (DB-lfMPUT) 

t0127J This is means for inputting information such as commands by an operator, and a keyboard, a touch screen, or 
the like is used for the input unit (DB-INPUT). 

10 Optical Magnetic Disk Drke (DB-MODD) 

[0128] This is a device which reads data out of the potable optical magnetic disk or writes them into it. 
Control Bus (DB-CBUS) 

IS 

[0129] This is a transmission path of various control information within the database. 
Image Bus (DB-IBUS) 

20 [0130] This Is a transmission path of image data within the database. 

[0131] First, a main function and operations of the worfcstation (WS) will be described. 

To display Identification information of an examined person, hearing information, image data, Infbrmatfon attached 

to examination information and an image, and a doctor's findings. 
25 " To display various information concerning abnormalities such as a type of abnormalities (disease), a position and 

degree of abnormalities, or the like. 
* To input the findings which are doctor's interpreting results, 
' To write various data into the portable optical magnetic disk or read them out of It. 

30 [0132] Next, a configuratton element and a function of the workstation (WS) will be described. Fig. 20 is a configura- 
tional diagram of the workstation (WS). 

Control UnH (WS-CTRL) 

35 [0133] This contains a central processing unit (CPU), system memories (namely, semiconductor memory), and the 
like and controls operations of the entire wori<station. 

System Disk (ES-SD) 

40 [01 34] This is a magnetic disk and stores a program etc. This program is read out when an electric power of the work- 
station (WS) is switched on. and written Into the system memories within the control unit (WS-CTRL). 

Input Unit(WS-INPUT) 

45 [01 35] This is means for inputting information such as commands, interpretation reports (remarks or findings), or the 
like by an operator, and a keyboard, a mouse, a touch screen, or the like is used for tiie Irput unit (WS-INPUT). The 
touch screen is mounted onto a screen of the display unit (WS-DISP). 

Data Memory (WS-MEM) 

so 

[0136] This is a device for temporarily storing various data such as image data etc. and is a magnetic disk and so on. 
Imaging Frame Memory (WS-IFM) 

55 [0137] This is a devkse lor temporarily storing a plural sheet of image data and may be a semiconductor memory and 
son on. 
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Image Display Manager (WS IDM) 

[01 38] This operates so as to display an image and an overlay. Fig. 21 is a conflgurationai diagram of the image dis- 
play manager (WS-IDM) and a part of the image display manager (WS-IDM) Is showvn within a broken line. This includes 
the following portions: 

a) Control Portion: 

This controls the entire configuration portion of the image display manager (WS-IDM); 

b) Overlay Data Making Portion: 

This makes overlay data (color) from overlay display information. This contains means for displaying by flicker- 
ing as to data Indicated in the overlay display information; 

c) Image Memory for Storing Image Data: 

This has memories corresponding to a sheet of image (a nntrix size is 2.048 x 2.048 pixels); 

d) Overlay Memory for Storing Overlay Data: 

Since the overlay data are displayed in color, the overlay memories conresponding to one screen are con- 
structed of three sheets of overly memory for red. green, and blue. In the overlay memory for each color, a matrix 
size is conoeptionally 2.048 x 2.048 pixels, and a bit length of 1 pixel is 1 bit. The relationship between a (fisplay 
cotor and a bit value of each pixel is shown in Fig. 22. In Fig. 22. tor example as shown in Step 2, a pixel value (a 
bit value of pixel) of a pixel coordinate (X, Y) of the overlay memory for red is 1 . and a pixel value of the same coor- 
dinate of the overlay memory for both green and blue is 0, and a red color is displayed as to the coordinate. On the 
other hand, black in a cfisplay color means that any colors are not displayed, and when black is doubly displayed on 
an image, only the image is displayed; 

e) Overlay Portion: 

An overlay portion superimposes image data on overlay data; 

f) Displaying Memory for Storing Display Data 

This image display manager (WS-IDM) has two sheets of memory for displaying a sheet of image (a matrix size 
is 2.048 X 2,048 pixels). This is equal to the number of the display units (WS-DISP). The memories for displaying 
correspond to the display units (WS-DISP), respectively; and 

g) D/A Converter 

This converts display data of digital data into those of analog data. 

This Is provided with the same number as the display unit (WS-DISP) so as to correspond to it. 

[01 39] The image display manager (WS-IDM) can receive the folfowing information: 

(a) Type of data to be displayed: 

One of three types can be displayed: an image only, an overlay only, an image and an overlay; 

(b) Designated information of the display unit (WS-DISP) displaying data; 

(c) Overlay display information: 

A type of a graphw. a size of a graphic, coordinates, a display color, presence or absence of display (containing 
a flicker), control Information, or tiie like per graphic; and 

(d) Image Data. 

[0140] When displaying an image overlapping an overlay, the image display manager (WS-IDM) operates in the fol- 
lowing manner: 

(1) The control portion of tiie image display manager (WS-IDM) receives the below-mentioned tiiree information 
from the control unit (WS-CTRL) of the workstation (WS): 

(a) "Images and overlays" as a type of data to be displayed; 

(b) A display unit number of the display unit (WS-DISP) display-ing data; and 

(c) Overlay Display Information. 

(2) The image display manager (WS-IDM) receives Image data and writes them into the image memories. 

(3) The overlay data making portion makes overlay data based on overlay display infomiation by an instruction of 
the control portion. Then, when control informalfon of present or absence of display is "display", the overlay data 
making portion makes the overlay data witti an indicated graphic, indicated coordinates, and indicated color data. 

(4) The image data and overlay data are read out by an instruction of the confrd portion to input them into ttie over- 
lay portion to synthesize the data. 
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(5) The synthesized data are written into cfispatying memories with an indicated display unit number. 

(6) The synthesized data are converted into analog data by the D/A converter. 

[0141 ] The above-mentioned operations (4) to (6) are always repeated during the display 
5 [0142] Only when the control information of present or absence of display (containing a flicker) denotes "display" as 
to a graphic in ceitain coordinates, the overiay data making portion writes the graphic into the overlay memories to dis- 
play it. 

[0143] On the other hand, when an image is just displayed, in the above-mentioned operation (1). the overlay data 
making portion receives: 

TO 

(a) "only image" as a type of data to be displayed: and ] 

(b) a display unit number of the display unit displaying data, however the portfon does not receive the overlay dis- \ 
play informa-lion. Then, in the above-mentraned operatton (4), the overlay data making portion does not read out 

the overiay data, and accordingly does not superimpose the image data on the overiay data. 

15 

Display Unit (WS-DISP) 

[0144] This is a device for displaying characters, graphics, and images, and a CRT display, a liquid crystal panel dis- 
play, or the like is used for the display unit. A color display is available. In this embodiment, two units are set 

■ 20 

Optical Mlagnetlc Disk Drive (WS-li40DD) 

[0145] This is a device for reading or writing data for a portable optical magn^ic disk. 
25 Control Bus (WS-CBUS) 

[0146] This is a transmission path of various control information witiiin the workstation. 
Im^e Bus (WS-IBUS) 

30 

[0147] This is a transmission path of image data and overlay data within tiie workstation. 
[0148] In this connection, a dock for referring to a date and a time (not shown in the figure) is integral witti the work- 
station (WS). 

[0149] Utilizing thus-constructed PACS, a ftow of a series of system operations is described, lor example, when read 
35 and interpreted is a chest X-ray image in a lung cancer examination. 
[0150] The operations will be carried out in tiie following procedure: 

1 . Input of hearing information; 

2. Acquisition of chest X-ray image: 
40 3. Registration of acquired data: 

4. Preparation of Interpreting data: 

5. Interpretation of image data: and 

6. Output of interpreting results 

45 [0151] Hereinafter, the above-mentioned series of system operations will be described in detail. 
1. Input of Hearing Examination 

(1) Display of Hearing Sheet 

so 

[0152] A hearing sheet is displayed on a display screen of the hearing information input unit (HI). 

(2) Input of Hearing Information 
55 [0153] 

(i) An oprator inputs examined person Wentification infomiation from the hearing information input unit (HI). The 
examined person klentification information is assigned to ttie examined person so as not to overlap each other 
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within such medical examination area, and an examined person ID number desaibed in a register shall here be 
inputted. The inputted data are displayed in a specific position on a screen. 

His to be noted that following terms such as person ID number, examined person ID number and exam- 
ined person indentiflcation Information are interchangeably used throughout this patent application, all of 
which have identical meaning to each other, 

(ii) An operator inputs a response obtained from the examined person in the hearing infbrmation input unit (HI). The 
inputted data are displayed in a specific position on a screen. 

[01 54] The above-mentioned Subsections (1 ) and (2) are repeated only by a number of examined persons. 
(3) Write Hearing Infbrmation into Optical Magnetic Disk 

[01 55] The control unit of the hearing information input unit (HI) reads out hearing infbrmation (examined person iden- 
tification information and responses from the examined persons) stored in the system disk by an instruction of an oper- 
ator, and writes it into the optical magnetic disk inserted into the optical magnetic disk drive (HI-MODD). 
[01 56] Thus-obtained optical magnetic disk is later carried to a certain position of the database (DB). 

2. Acquisition of Chest X-ray Images 

(1 ) Input of Examined Person Identification Information 

[0157] An operator inputs examined person identification infbrmation from the input unit (lA-INPUT) of the image 
acquisition unit (lA). The inputted data are displayed in a specific position on a screen of the display unit (lA-DISP). 

(2) Acquisition of Digital Image 
[0158] 

(i) The control unit (lA-CTRL) indicates to expose X-rays and image to the X-ray generator (lA-XGEN) and the X- 
ray imaging unit (lA-IMG). The X-ray generator (lA-XGEN) generates X-rays and Irradiates them onto a peison to 
be exposed (person to be examined). The X-rays transmitted through the person to be exposed are detected by the 
X-ray imaging unit (lA-IMG) to obtain digital images. The X-ray imaging unit (lA-IMG) transmits image data to the 
image bus (lA-IBUS). As a result, the image data unit (lA-IM) receives the image data to write them to itself. 

(ii) The control unit (lA-CTRL) writes information attached to imaging conditions or images together with examined 
person identification information into the system disk (lA-SD). 

[01 59] The above-mentioned Subsections (1 ) and (2) are repeated only by a number of persons to be examined. 

(3) Write into Optical Magnetic Disk of Data 
[0160] 

(i) The control unit (lA-CTRL) reads out information attached to an examination and an image which is stored in the 
system disk (lA-SD) by an instruction of an operator, and writes it into an optical magnetic disk inserted into the 
optical magnetic disk drive (lA-MODD). 

(ii) The control unit (lA-CTRL) successively reads out image data from the image data unit (lA-IM) and writes them 
into the optical magnetic disk inseted into the optical magnetic disk drive (lA-MODD). 

[01 61 ] Thus-obtained optical magnetic disk is later carried to the place where the database exists (DB). 

3. Registration of Acquired Data 
[0162] 

(i) An operator inserts the optical magnetic disk registering hearing infbrmation into the optical magnetic disk drive 
(DB-MODD) of the database (DB), and inputs a hearing infbrmation readout command of the optical magnetic disk 
from the input unit (DB-INPUT). Then, by an instruction of the control unit (DB-CTRL), the optical magnetic disk 
drive (DB-MODD) reads out the hearing infbrmation registered in the optical magnetfe disk and writes it into the 



Patent provided by Sughrue Mig^ PLLC - http://www.sughrue.com 



EP0973116A1 



data storing unit (DB-STRG). The control unit (DB-CTRL) extracts information (hereinafter, referred to as directory 
information. Refer to Fig. 23) registered in a data directory from the hearing information to send it to the search unit 
(DB-SRCH). The search unit (DB-SRCH) stores the received directory inforniation. 

[0163] Furthermore, the control unit (DB-CTRL) extracts the previously radiographed image data of examined per- 
sons (hereinafter, called previous image data or image data in the past) from the examined person identification infor- 
mation of the hearing information from the data storing unit (DB-STRG) to send them to the search unit (DB-SRCH). 
The search unit (DB-SRCH) adds the received previous image data to the directory information, (ii) An operator inserts 
the optical magnetic di^ registering information attached to an examination and an image, and the image data into the 
optical magnetic disk drive (DB-MODD) of the datat}ase (DB). and inputs an image information readout commartd of 
the optical magnetic disk from the input unit (DB-INPUT). Then, by an instruction of the control unit (DB-CTRL). the opti- 
cal magnetic disk drive (DB-iy/IODD) reads out the information attached to an examination and an image, and the image 
data which are registered in the opttoal magnetic disk, and writes it into the data storing unit (DB-STRG). The control 
unit (DB-CTRL) extracts directory Information from the information attached to an examination and an image to send it 
to the search unit (DB-SRCH). The search unit (DB-SRCH) stores the received directory information 

4. Preparation of Interpreting Data 

(1) Abnormality Detection from Image 
[0164] 

(i) When data registration is completed, the control unit (DB-CTRL) of the database (DB) indicates to search the 
images ( oomprisised of images to be interpreted and previous Images) registered in the search unit (DB-SRCH) 
to obtain a response. Successively, the control unit (DB-CTRL) indicates to perform the following abnormality 
detecting operations for each sheet of images. The detected abnomiality is represented by shadows of pulmonary 
nodules. 

(ii) Image data corresponding to a sheet of image are read out from the data storing unit (DB-STRG) to send them 
to ttie image processing unit (DB-IP). The image processing unit (DB-IP) receives the image data and operates pul- 
monary nodules shadow detecting means having inside to detect specific positions on the images having doubtful 
abnormalities. The detected positions of abnormalities are recognized by an absolute coordinate system on coor- 
dinate axes formed by an image upper end and an image left end as shown in Fig. 24, and written into the abnor- 
mality data table as shown in Fig. 25. In the image of tfie examination ID number 920001. abnomial shadows are 
detected at two positions of Nl (700. 1200) and rsl2 (1500. 1000). In abnormality judgments on the entire image, 
when tiie abnormality has not entirely been detected, "normal", and when at least one abnormality has been 
detected, "doubtfully abnormal". In the image of the examination ID number 920001 . as the abnormality is 
detected, the abnamality judgement on tiie entire image is made as a "doubtful abnormality". The abnomiality 
data table showing detection results are stored In the data storing unit (DB-STRG). 

[01 65] TTie abnomiality data tables in the Images of the examinatfon ID numbers 920002 to 920005 are shown in Figs 
26 to 29. 

(2) Preparation of Interpreting Data 

[01 66] When an abnormality detecting processing from images is finished, the control unit (DB-CTRL) of the database 
(DB) indicates the data storing unit (DB-STRG) to read out data of images to be interpreted, previous image data, hear- 
ing information, and information attached to an examination and an image (containing an abnamality data table), and 
indicates the optical magnetic disk drive (DB-MODD) to write them. The data storing unit (DB-STRG) reads out these 
data to be sent to the image bus (DB-IBUS). The optical magnetic disk drive (DB-MODD) receives these data to write 
into the optical magnetic disk. 

[0167] In a medical group examination, two doctors interpret an Image. Accordingly, two sheets of optical magnetic 
disk are prepared and are carried to workstations (WS), respectively 

5. Interpretation of image Data 

(1) Input of Interpreting Data into Wor1<station (WS) 

(0168] An operator inserts the optical magnetic disk registering data of images to be interpreted, previous image data. 
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hearing information, and information attached to an examination and an Image into the optical magnetic disk drive (DB- 
MODD) of the workstation (WS) and inputs a data readout command derived from the optical magnetic disk from the 
input unrt (WS-INPUT). Then, by an instruction of the control unit (WS-CTRL). the optical magnetic disk drive (DB- 
MODD) reads out the data stored in the optical magnetic disk and writes them into the data memory (WS-MEM). The 
data of images to be interpreted, the previous image data, the hearing information, and the information attached to an 
examination and an image are memorized com'esponding to each exanrtined person. 

(2) Display of Image 

[0169] The workstation displays the Images to be inetrpreted. Now. as two display units (WS-DISP) are provided, a 
sheet of image to be interpreted (the exanvnation ID number 920001) is automatically displayed on the left-sided dis- 
play unit (WS-DISP) and the previous image (the examination ID number 910041) is automatically displayed on the 
right-sided display unit (WS-DISP). Also, when an image is displayed on the display unit (WS-DISP), its examination ID 
number (existent in information attached to an image) is displayed. 

(3) From the interpretation to inputs of findings as the results, the following procedures are can-ied out: 
[0170] 

(a) An interpreting doctor reads the displayed images. When the Interpreting doctor displays images and Interprta- 
tion reports other than the displayed one, he/she inputs a command for it from the input unit (WS-INPUT) and oper- 
ates. 

(b) When the interpreting doctor finishes interpreting the image, he/she points out a position of pulmonary nodulous 
shadows on the image to be interpreted by a mouse. 

The control unit (WS-CTRL) reads out the coordinates of the abnormality position Inputted to store it. and cre- 
ates a finding data table as shown in Fig. 30. Then, the image display manager (WS-IDM) creates overlay display 
information describing "an^ow, coordinare of abnormality position, white, and display" as to the abnormality in each 
finding number referring to the finding data table. The created overiay display information is shown in Fig. 31 . The 
image display nr»nager (WS-IDM) creates an overlay according to the overlay display information to display it. As 
a result, an arrow is displayed in a position that a doctor indicates on ttie image. The control unit (WS-CTRL) writes 
the overlay display information created into the data memory (WS-MEM) con^esponding to the examination ID 
number. 

(c) When an interpreting doctor recognizes an abnomnality other than the pulmonary nodules, hefshe inputs an 
abnonmality type selecting command from the input unit (WS-INPUT) to select the corresponding abnormality type 
among several types of abnormality type displayed. Next, when he/she inputs the position of abnormalities, a 
method of inputting the position of abnonnalities is different according to tfie type of abnormalities. For example, in 
interstitial lung disease, he/she inputs an abnormality scope by enclosing it with a closed curved line by using a 
mouse. In this case, tiie confrol unit (WS-CTRL) memorizes an area instead of the position. 

A doctor carrys out the same operations and adds information relating to an abnormality to an overiay to be 
memorized and displays on the image. 

(d) When an interpreting doctor inputs all discovered abnormalities, he^he inputs an interpretation completing 

command. 

[01711 When the finding data table is inputted as an abnormality, tiie control unit (WS-CTRL) writes ttie diagnosed 
results of the entire image as an 'abnormality" into the finding data table, and when the finding data table is not inputted 
as an abnormality, the control unit (WS-CTRL) writes the diagnosed results of the entire image as a "normality" Into the 
finding data table to memorize into the data memory (WS-MEM). 

(4) Comparison and Classification of Diagnostic Information 

[01 72] The control unit (WS-CTRL) reads out a finding data table which is interpreting results and an abnormality data 
table which is the corresponding CAD processing results from the data memory (WS-MEM). 
[01 73] In the same manner as the overlay display information is created from the finding data table in Section 5. Sub- 
section (3). the image display manager (WS-IDM) creates the overlay display information from ttie abnormality data 
table indicating tiiat a display color is "red" and memorizes it into the data memory (WS-MEM) conresponding to ttie 
examination ID number. The overiay display information created from ttie abnormality data table of the CAD processing 
results concerning ttie examination ID number 920001 is shown in Fig. 32. 

[01 74] The control unit (WS-CTRL) extracts botti the diagnostic results of the entire image from ttie finding data table 
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and the judged results of the entire image of the CAD processing from the abnormality data table to conpare the both 
results to classify the following four cases: 

Case a: The doctor judges as an "abnornmlity". but the CAD judges as a "normality". 
Case b: The doctor judges as an "abnormality", but the CAD judges as a "doubtful abnormality*. 
Case c: The docta judges as a "nonnality", and the CAD also judges as a "normality". 
Case d: The doctor judges as a "normal)^", but the CAD judges as a "doubtful abnomiality". 

[0175] For example, as. concerning the examination ID number 920001 . the doctor judges as an "abnormaHty" and 
the CAD judges as a "doubtful abnormality", this case is classified into the case b. 

[0176] According to the above-mentioned classification results, the later operations are different. The available oper- 
ations are described below. 

(a) When classifying into the case a. the following operations are available: 

(a-1) An examination ID number is registered in an abnormali-ty detecting result list. 
(a-2) No operations. 

(b) When classifying into the case b^ the following operations are available: 

(b-1) With reference to a finding data table and an abnormality data table, at least a type of an abnormality and Its 
position are compared and classified. An examination ID number of an image having a discrepancy in the type of 
an abnormality and its position is registered in an abnormality detecting result list. 
(b-2) No operations. 

(c) When classifying into case c, no operations. 

((9 When classifying Into case d. the following operations are available: 

(d-1) An examination ID number is registered in an abnormality detecting result list. 

(d-2) No operations. 

[0177] Herein, the respective operations (a-l), (b-1), and (d-1) will be explained. 
As to the operations (a-1 ) and (d-1 ), 

[0178] The control unit (WS-CTRL) reads out the abnormalrty detecting result list (if it does not exist, create it) and 
writes it into an examination ID number to be menwrized into the data memory (WS-MEM). 

As to the operation (b-1), 

[0179] The explanation is made according to an example of the examination ID number 920001 . When seeing finding 
numbers 1 and 2 with reference to Fig. 30, the type of an abnormality is pulmonary nodules. In the pulmonary nodules, 
a scope to be processed by the CAD is the entire image. Also, a method of Indicating the position of an abnormality by 
a doctor is the same as that by the CAD to show it with an arrow on the overlay. Accordingly, it Is determined that the 
position of an abnormality shall be shown with a tip of an arrow to seek its coordinate. From Figs. 25 and 30. the respec- 
tive coordinates are A1 (1520. 1040). A2 (1430. 659). N1 (700. 1200). and N2 (1500, 1000). 
[0180] If distances between the positions of an abnormality (A1 . A2) indicated by the doctor and between the positions 
of an abnormality (N1 . N2) delected by the CAD are less than a predetemiined value AO (=100). the identical positions 
of an abnormality shall be indicated. 

Comparison of A1 and N1: V {(1520 - 700)^ + (1040 - 1200)^} = 835 > 100 

Comparison of A1 and N2: V {(1520 • 1500)^ + (1040 - 1000)^} = 45 < 100 

Comparison of A2 and N1 : V {(1430 - 700) ^ + (659 - 1200) ^) = 909 > 100 

Comparison of A2 and N2: V {(1430 • 1500) ^ + (659 • 1000) ^} = 348 > 100 

[0181] Accordingly, A1 and N2 indicate the identical abnormality and the information of controlling presence or 
absence of a display of N2 in the overlay display information of the CAD processing results is rewritten from a "display" 
to a "non-display". Only the CAD shall detect N1 and the doctor shall not indicate it. and the information of controlling 
presence or absence of a display is still a "display". Also, only the doctor shaD discover A2 and the CAD shall not detect 
it. 
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[01 82] As described above, when the doctor overlooks abnormalities or diagnoses excessively and the abnomelitles 
pointed out by the doctor and the CAD are inconsistent, the control unit (WS-CTRL) writes the examination ID nurrtoer 
of this image into the abnormality detecting result list 

(5) Display of Comparing Results and Creation of Abnormality Detecting Result List 

[0183] The operations conresponding to the number of all sheets of images to be interpreted in Section 5. Subsections 
(1) to (4) are repeated. 

[0184] The control unit (WS-CTRL) extracts the diagnostic results and the judging results for the entire image from 
the finding data table of the doctor and the abnormality data table of the CAD. and a part of results compared and clas- 
sified is shown in Fig. 33. The interpreted images are 50 sheets of the examination ID numbers 920001 to 920050. The 
classified results were: 

Case a: 5 sheets Case b: 1 5 sheets 
Case c: 26 sheets Case d: 4 sheets 

[0185] Thereafter, the control unit (WS-CTRL) displays the classified results in Section 5. Subsection (4) in the display 
unit (WS-DISP) as shown in Fig. 34. 

[0186] The doctor selects the operations after classified as described in Section 5. Subsection (4). The doctor Inputs 
an operation selection command from the input unit (WS-INPUT) to select an operation conforming to his/her way of 
thinking. In this embodiment, the doctor shall select (a-2), (b-2). and (d-1). When the doctor inputs the command, the 
control unit (WS-CTRLJ operates (d-1 ) and creates an abnormality detecting result list 

(6) Re-interpretation and Reference of Abnormality Detecting Resuft 

[0187] A doctor inputs a re-interpretation command. Then, the control unit (WS-CTRL) reads out the data of images 
to be interpreted which register the examination ID number in the abnormality detecting result list and the information 
relating to the examined persons (hearing information, information attached to an examination and an image (an abnor- 
mality data table, a finding data table, overlay display information), previous Image data) from the data memory (WS- 
MEM). and superimposes the image to be interpreted on the overlay meaning his/her finding to display it on the left- 
sided display unit (WSrDISP) of two display units (WS-DISP). and superimposes the overiay meaning the CAD 
processing results concerning the image on the image to display It on the right-sided display unit (WS-DISP). 
[0188] The doctor reads an image and compares his/her finding with tiie CAD processing results. 
[0189] When displaying the images and the interpretation reports other than those displayed, tiie doctor ir^uts a com- 
mand for it from the input unit (WS-INPUT) and operates 

[0190] When the doctor finishes interpreting the image and discovers shadows of an abnormality, he/she points out 
its position on the Image to be interpreted by a mouse. Also, he/she can correct the position of an abnormality which is 
pre\/iously pointed out by a mouse. 

[0191] Thereafter, a doctor operates in the same manner as operated in Section 5. Subsection (3). (c) and after, 
he/she inputs all the discovered abnonnalities. The control unit (WS-CTRL) memorizes the corrected finding data table 
into the data memory (WS-MEM), and the overlay of the next image and the doctor's finding and the overlay of the CAD 
processing result, which are registered into the abnormality detecting result list, are displayed in the display unit (WS- 
DISP). 

[01 92] As described above, the procedure as described in Subsection (6) will be earned out for all the images regis- 
tered in the abnormality detecting result list. 

(7) Write of Finding data Into Optteal Magnetic Disk 

[01 93] The control unit (WS-CTRL) reads out the finding data table concerning all the images to be interpreted from 
the data memory (WS-MEM) and writes it into the optical magnetic disk Inserted into the optical magnetic disk drive 
(WS-MODD). 

[0194] These operations in Section 5, Subsections (1) to (7) will be carried out at two locations. 6. Output of Interpre- 
tation Results 

(1) Registration of Finding Data into Database 

[01 95] An operator inserts tiie optical magnetic disk memorizing tiie finding data additionally into the optical magnetic 
disk drive (DB-MODD) of the database (DB). and inputs a finding data readout command of the optical magnetic disk 
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from the input unit (DB-INPUT). Then, by an instruction of the control unit (CB-CTRL), the optical magnetic disk drive 
(DB-MODD) reads out the finding data memorized in the optical magnetic disk and writes them into the data storing unit 
(DB-STRG). The control unit (DB-STRL) extracts directory information from the finding data to be sent to the search 
unit (DB-SRCH). The search unit (DB-SRCH) stores the received directory information. 

[0196] Another sheet of optical magnetic disk is also registered into the database in the same manner. Thus, the two 
doctors' finding data concerning the kientical examination image have been inputted into the databasa 

(2) Extraction of Persons To Whom Close Examination Is Required 
[0197] 

(i) An operator inputs an extracting command of persons to be made a close examination and an operation select- 
ing command from the input unit (DB-INPUT) of the database (DB). Then, by an instruction of the control unit (DB- 
CTRL), the search unit (DB-SRCH) searches a finding data table of a chest X-ray examination which has not been 
made overall judgments of interpretation results Qudgements as to whether a dose examination is necessary or 
not), and reads out the examined person Identification information and the two doctors' diagnostic result informa- 
tion in the system memory of the control unit (DB-CTRL). 

(li) The control unit (DB-CTRL) extracts the two doctors* diagnostic results of each examined person from the find- 
ing data table and the following comparison will be made: 

Case a: Both of the two diagnosed results are "normaP. 

Case p: One of the diagnosed results is "abnormal, but tiie otiier "normal". 

Case 7: Both of the two disgnosed results are "abnormal". 

A deciding metiiod of overall judgements can be selected. Selection may be made in the following manner: 

In the case a, the overall judgement is "normal". 

In the case p, tiie following two selections are available. 

(p-1): The overall judgement is made as "abnormal". 

(p-2): The overall judgement is made as "normal". 

In the case y. the following two selections are available 

(y-1): no operation is carried out and the overall judgement is made as "abnormal". 
{y-2): The diagnostic information in Section 5. Subsection (4) is compared and classified for the position of 
abnormalities in the two finding data tables, namely compared and classified concerning the position of abnor- 
malities in accordance with the type of abnormalities. In this case, the overall judgement is made as "abnor- 
mal". 

(Hi) In this embodiment, an operator inputs, from Input unit (DB-INPUT). a command for selecting the above-men- 
tioned operation (p-1) and (r-1) concurrently witii a command of extracting persons to be made a close examina- 
tion. Then, the overall judements are transferred to the data storing unit (DB-STRQ) and the search unit (DB- 
SRCH) coH'esponding to the examined person identifk»tion information to be stored therein. 

(3) Output of Interpretation Results 

[0198] The control unit (DB-CTRL) reads out the overall judgements from the data storing unit (DB-STRG). According 
to results of the overall judgement the following operations are available: 

[0199] When the overall judgement results are "^normal", the overall judgement results are written into the optical mag- 
netic disk corresponding to the examined person idenfiftcatton information and tiie name of examined person. 
[0200] When the overall judgement results are "abnormal", the control unit (DB-CTRL) Indicates the search unit (DB- 
SRCH) to search the image to be interpreted from the data storing unit (DB-STRG) to be read out. The two doctors' 
finding data table and overall judgements and the images to be interpreted are written into the optical magnetic disk cor- 
responding to the examined person identification infornrntion and the name of examined person. 
[0201 ] The optical magnetic disk is carried to a person to receive the report 

[0202] At this time, a f k)w of a series of system operations for interpreting the chest X-ray image in tiie lung cancer 
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examination is completed. 

[0203] Next, an embodimeni according to the third embodiment of the present invention will be explained. As 
desaibed above in Rgs. 13A, 13B and 14. a flow of a series of system operations in the thiid embodiment is earned 
out in the following procedures in the same manner as that in the second enrtKxJiment: 

1 . Input of hearing information 

2. Acquisition of chest X-ray image 

3. Registration of acquired data 

4. Preparation of interpreting data 

5. Interpretation of image data 

6. Output of interpreting results 

[0204] Then, as the procedures in the items 1 to 3 are same as that of the second embodiment the description there- 
fa will be omitted. The tiiird embodiment will be described in a similar example as in the second embodiment where 
the chest X-ray image in the lung cancer examination is interpreted. 

4*. Preparation of Interpreting Data 

(1) Detection of Abnormality from Image 
[0205] 

(i) When registration of data is completed, the control unit (DB-CTRL) of ttie database (DB) indicates to search 
images registered in the search unit (DB-SRCH) (an Image to be interpreted and a previous image) and obtains a 
response. Successively, the following abnormality detecting operation is earned out for each image. The abnormal- 
ity to be detected is shadows of pulmonary nodules. 

(ii) The control unit (DB-CTRL) reads out data corresponding to a sheet of image from the data storing unit (DB- 
STRG) to be sent to the image processing unit (DB-IP). When the image processing unit (DB-IP) receives the 
Image data, it activates and operates means for detecting shadows of pulmonary nodules which is provided therein 
to detect a position of a doubtful abnorniality on the image. The detected position of the abnormalities is on the 
coordinate axis of a left end of the image. It is recognized on the absolute coordinate system as shown in Fig. 24 
and written Into the abnormality data table as shown in Fig. 25. In the image of the examination ID number 920001 , 
the abnormal shadows are detected at two positions of N1 (700. 1200) and N2 (1500. 1000). In the abnormality 
judgement of the entire image, when an abnormality is not entirely detected, "normal", and when at least one 
abnormality is detected, "doubtfully abnornial". In the image of the examination ID number 920001, as the abnor- 
mality is detected, the abnormality judgement of the entire image is "doubtfully abnornial". The abnormality data 
table which is detected results is stored In the data storing unit (DB-STRG). 

[0206] The abnormality data tables in the image of the examination ID numbers 920002 to 920005 are shown in Ros 
26 to 29. ^' 

(2) Preparation of Interpreting Data 

[0207] When the abnormality detection processing from the images is completed, the control unit (DB-CTRL) of the 
database (DB) indicates the data storing unit (DB-STRG) to read out data of images to be interpreted, previous image 
data, hearing information, and information attached to an examination and an image (containing the abnormality data 
table), and indicates the optical magnetic disk drive (DB-MODD) to write them. The data storing unit (DB-STRG) reads 
out these data to send to the image bus (DB-IBUS). The optical magnetic disk drive (DB-MODD) receives these data 
to write into the optical magnetic disk. 

[0208] In the medical gropp examination, two doctors interpret images. Accordingly, two optical magnetic disks are 
prepared and carried to two workstations (WS) each disk. 

5*. Interpretation of Image Data 

(1) Input of Interpreting Data into Wbrkstation 

[0209] An operator inserts the optical magnetic disk memorizing data of images to be Interpreted, previous image 
data, hearing information, and Infbnmation attached to an exantinatnn and an image into the optical magnetic disk drive 
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(WS-MODD) of the workstation (WS). and inputs a data readout command derived from the optical magnetic disk from 
the input unit (WS-INPUT). Then, by an instruction o1 the control unit (WS-CTRL). the optical magnetic disk drive (WS- 
MODD) reads out the data memorized In the optical magnetic disk and writes them into the data memory (WS*MEM). 
The data of images to be interpreted, the previous image data, the hearing information, and the information attached to 
5 an examination and an Image are memorized corresponding to each examined person. 

[021 0] The control unit (WS-CTRL) aeates the overlay display information from the abnonnality data table and the 
overlay display information is memorized in the data memory (WS-MEM) conresponding to the examination ID numbers. 
The overlay display infbmnation created from the abnormality data table of the examination ID number 920001 is shown 
in Rg. 32. Similariy. the overlay display infbrmation Is aeated tbr each examination ID number. 

70 

(2) Display of Image 

[021 1 ] The woristation displays images to be interpreted. Now. as two display units (WS-DISP) are provided, a sheet 
of image to be interpreted (the examination ID number 910001) is automatically displayed in the left-sided display unit 
16 (WS-DISP). Furthermore, when an image is displayed in the display unit (WS-DISP). its examination ID number 
(included in the information attached to an image) is displayed. 

(3) Input of Interpreting Finding 

20 [021 2] From the interpretation to an input of findings which are Its results, the following procedure is carried out: 

(a) An interpreting doctor reads an image displayed. 
When displaying an image or an interpretation report other than the dsplayed image, the doctor inputs a com- 
mand for it from the input unit (WS-INPUT) and operates. 

When displaying the CAD processing results in the case of referring to the CAD processing results, the doctor 
inputs a CAD processing result display command from the input unit (WS-INPUT). Then, the control unit (WS- 
CTRL) indicates the image display manager (WS-IDM) to create an overlay according to the overlay display infor- 
mation and to siperimpose it on the image to be interpreted in the left-sided display unit (WS-DISP) to display it, 
and also to register the examination ID number in the CAD processing result reference list to memorize it in the data 
memory (WS-MEM). When an operator desires to delete the CAD processing results, he/she inputs a CAD 
processing result deleting command from the input unit (WS-INPUT). Then, the control unit (WS-CTRL) indicates 
the image display manager (WS-IDM) to delete the overlay 

(b) When a doctor finishes interpreting an image, he/she points out a position of shadows of pulmonary nodules on 
the image to be interpreted with a mouse. 

The control unit (WS-CTRL) reads a coordinate of the inputted position of an abnonnality to merrorize to cre- 
ate the finding data table as shown in Fig. 30. Then, the image display manager (WS-IDM) aeates overiay display 
information describing "arrow, coordinate of position of abnormalities, white, display" as to the abnormality of each 
finding number with reference to the finding data table. The created overiay display information is shown in Fig. 31 . 
The image display manager (WS-IDM) creates the overlay according to the overiay display infbrmation to display 
rt. As a result, an arrow is diplayed in a position where the doctor points out on the image. The control unit (WS- 
CTRL) writes the created overlay display information into the data memory (WS-MEM) corresponding to the exam- 
ination ID number. 

(c) When an interpreting doctor recognizes an abnormality other than pulmonary nodules, he/she inputs an abnor- 
maity type selecting command from the input unit (WS-INPUT) and selects a conresponding type of abnormalities 
among the displayed several types of abnormalities. Next, the doctor inputs a position of abnormalities and a 
method of inputting tiie position of abnormalities is different for each type of abnormalities. For example, in the 
interstitial lung disease, the doctor inputs it by enclosing a scope of abnormalities with a closed curved line by using 
a mouse. In this case, the control unit (WS-CTRL) memorizes an area instead of a position. 

A doctor carrys out the same operations and adds information relating to an abnormality to an overlay to be 
memorized and displays on the image. 

(d) When an inteipreting doctor inputs all discovered abnonmalities. he/she inputs an interpretation corr^ieting 
command. 

[021 3] When the finding data table is inputted as an abnormality, the control unit (WS-CTRL) writes the diagnosed 
55 results of the entire image as an "abnormality" into the finding data table, and when the finding data table is not inputted 
as an abnormality, the control unit (WS-CTRL) writes the diagnosed results of the entire Image as a "normality" Into the 
finding data table to memorize into the data memory (WS-MEM). 
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(4) Comparison and ClassHicaiion of Diagnostic Information 

[0214] The control unit (WS-CTRL) reads out a finding data table which is interpreted results and an abnormality data 
table which is the corresponding CAD processing results and the CAD processing result reference list from the data 
5 memory (WS-MEM). When the examination ID number is registered in the CAD processing result reference list, the 
control unit (WS-CTRL) oon^pares diagnostic information. In this case, It classifies into tt)e following case e to conplete 
Subsection (4). 

[0215] Case e: A doctor has already referred to ttie CAD processing results as interpreting images. 
[0216] When ttie examination ID number is not registered in the CAD processing reajit reference list, the control unit 
10 (WS-CTRL) extracts the diagnosed results of ttie entire image from the finding data table and the judged results of ttie 
entire image of the CAD processing from the abnormality data table, and compares the both results to classify them into 
the following four cases: 

Case a: The doctor judges as an "abnormality", but tiie CAD judges as a "normality". 
75 Case b: The doctor judges as an "abnormality", but ttie CAD judges as a "doubtful abnormality". 
Case c: The doctor judges as a "normality" and ttie CAD also judges as a "normality". 
Case d: The doctor judges as a "normality", but tiie CAD judges as a "doubtful abnormality". 

[0217] For example, as. concerning the examination ID number 920001 , tiie doctor judges as an "abnormality" and 
20 the CAD judges as a "doubtful abnormality", this case is classified into tiie case b. 

[0218] According to ttie above-mentioned classification results, tiie later operations are different. The available oper- 
ations are described below. 

(a) When classifying into tiie case a, the following operations are available: 

25 (a-1) An examination ID number is registered in an abnormali ty detecting result list 
(a-2) No operations. 

(b) When classifying into tiie case b. the following operations are available: 

(b-1) With reference to a finding data table and an abnormality data table, at least a type of an abnormality and its 
position are compared and classified. The examination ID number of an image having a discrepancy in tite type of 
30 an abnormality and its position is registered In an abnormality detecting result list. 
(b-2) No operations. 

(c) When classifying into ttie case c, no operations. 

(d) When classifying into the case d. the following operations are available. 

(d-1) An examination ID number is registered in an abnormality detecting result list. 
35 (d-2) No operations. 

[0219] Herein, ttie respective operations (a-1), (b-1), and (d-1) will be e)q3lained. 

As to the operations (a-1) and (d-l), 

40 

[0220] The control unit (WS-CTRL) reads out ttie abnormality detecting result list (if it does not exist, create It) and 
writes It into the examination ID number to be memorized into ttie data memory (WS-MEM). 

As to the operations (b-1): 

45 

[0221] The explanation is made according to an example of ttie examination ID number 920001 . When seeing finding 
numbers 1 and 2 with reference to Fig. 30. ttie type of an abnormality is pulmonary nodules. In the pulmonary nodules, 
a scope to be processed by the CAD is ttie entire image. Also, a mettiod of indicating ttie portion of an abnormality by 
a doctor is the same as that by the CAD to show it witti an arrow in ttie overlay Accordingly, it is determined that ttie 
so position of an abnormality shall be shown witti a tip of an arrow to seek its coordinate. From Figs. 25 and 30, the respec- 
tive coordinates are Al (1520. 1040). A2 (1430, 659). Nl (700. 1200). and N2 (1500. 1000). 
[0222] If distances between tiie positions of an abnormality (Ai . A2) indicated by ttie doctor and between ttie positions 
of an abnormality {N^,N2) detected by ttie CAD are less ttian a predetermined value AO (=100), the Identical positions 
of an abnormality shall be indicated. 

55 

Comparison of Al and Nl : V {(1520 - 700) % (1040 - 1200) ^) = 835 > 100 
Comparison of Al and N2: V {(1520 - 1500)^ + (1040 - 1000)^} o 45 < 100 
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Comparison ot A2 and N1: V {(1430 - 7Q0)~ -i- (659 - 1200)*) ° 909 > 100 

Comparison of A2 and N2: V {(1430 - 1500) ^ + (659 - 1000) ^} = 348 > 1 00 

5 [0223] Accordingly, A1 and N2 indicate the identical abnormality and the information of controlling presence or 
atjsence of a display of N2 In the overlay di^ay information of the CAD processing results is rewritten from a "display" 
to a "non^Jisplay". Only the CAD shall detect N1 and the doctor shall not indicate it and the information of controlling 
presence or absence of a display Is still a "display". Also, only the doctor shaD discover A2 and the CAD shall not detect 
it. 

10 [0224] As described above, when the doctor overlooks abnormalities or diagnoses excessively and the abnormalities 
pointed out by the doctor and the CAD are inconsistent the control unit (WS-CTRL) writes the examination ID number 
of this image into the abnormality detecting result Osi 

(5) Display of Comparing Results and Creation of Abnormality Detecting Result List 

IB 

[0225] The operations corresponding to the number of all sheets of images to be interpreted in Section 5, Subsections 
(1) to (4) are repeated. 

[0226] The control unit (WS-CTRL) extracts the diagnostic results and the judging results for the entire image from 
the finding data table of the doctor and the abnormality data table of the CAD. and a part of results compared and das- 
20 sified is shown in Rg. 33. The interpreted images are 60 sheets of the examination ID numbers 920001 to 920060. The 
classified results were: 

Case a: 5 sheets Case b: 15 sheets 
Case c: 26 sheets Case d: 4 sheets 
25 Case e: 10 sheets 

[0227] Thereafter, the control unit (WS-CTRL) displays the classified results in Section 5. Subsection (4) on the dis- 
play unit (WS-DISP) as shown in Fig. 34. 

[0228] The doctor selects the operations after classified as described in Section 5. subsection (4). The doctor inputs 
30 an operation selection command from the input unit (WS-INPUT) to select an operation conforming to his/her way of 
thinking. In this embodiment the docta shall select (a-2). (b-2). and (d-1). When the doctor inputs the command, the 
control unit (WS-CTRL) operates (d-1) and creates an abnormality detecting result list. 

(6) Re-interpretation and Reference of Abnormality Detecting Results 

35 

[0229] A doctor inputs a re-interpreting command. Then, the control unit (WS-CTRL) reads out the data of images to 
be interpreted which register the examination ID number in the abnormality detecting result list and the information 
relating to the examined persons (hearing information, information attached to an examination and an image (an abnor- 
mality data table, a finding data table, overiay display information), previous image data) from the data memory (WS- 

40 MEM), and superimposes the image to be interpreted on the overlay meaning his/her finding to display it on the left- 
sided display unit (WS-DISP) of two display units (WS-DISP). and superimposes the overlay meaning the CAD 
processing results concerning a specific image on the image to display it on the right-sided display unit (WS-DISP). 
[0230] The doctor reads an image and compares his/her finding with the CAD processing results. 
[0231 ] When displaying the images and the interpretation reports other than those displayed, the doctor inputs a oom- 

45 mand for it from the input unit (WS-INPUT) and operates. 

[0232] When the doctor completes interpreting the image and discovers shadows of an abnormality, he/she points 
out its position on the image to be interpreted by a mouse. Also, he/she can correct the position of an abnormality which 
is previously pointed out by a mouse. 

[0233] Thereafter, a doctor operates in the same manner as operated in Section 5, Subsection (3). (c) and after, 
so he/she inputs all the discovered abnormalities. The control unit (WS-CTRL) memorizes the corected finding data table 
into the data memory (WS-MEM), and the overlay off the next image and the doctor's finding and the overlay of the CAD 
processing results, which are registered Into the abnormality detecting result list, are displayed in the display unit (WS- 
DISP). 

[0234] As described above, the procedures as described in Subsec-tion (6) will be carried out for all the images reg- 
55 istered in the abnormality detecting result list 
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(7) Write of Finding Data into Optical Magnetic Disk 

[0235] The control unit (WS-CTRL) reads out the finding data table concerning all the Images to be interpreted from 
the data memory (WS-MEM) and writes H into the optical magnetic disk Inserted into the optical magnetic disk drive 
(WS-MODD). 

[0236] These operations in Sectbn 5, Subsections (1) to (7) will be carried out at two locations. 6\ Output of Interpre- 
tation Results 

(1) Registration of Rnding Data into Database 

[0237] An operator inserts the optical magnetic disk memorizing the finding data additionally Into the optical magnetic 
disk drive (DB-MODD) of the database (DB). and inputs a finding data readout command of the optical magnetic disk 
from the input unit (DB-INPUT). Then, by an instruction of the control unit (DB-CTRL), the optical magnetic disk drive 
(DB-MODD) reads out the finding data memorized in the optical magnetic disk and writes them into the data storing unit 
(DB-STRG). The control unit (DB-STRL) extracts directory information from the finding data to be sent to the screen 
unit (DB-SRCH). The search unit (DB-SRCH) stores the received directory information. 

[0238] Another sheet of optical magnetic disk is also registered into the database in the same manner. Thus, the two 
dostors' finding data concerning the identical examination image have been inputted into the database. 

(2) Extraction of Persons to be Made Close Examination 
[0239] 

(i) An operator inputs an extracting command of persons to be made a dose examination and an operation select- 
ing command from the input unit (DB-INPUT) of the detabase (DB). Then, by an instruction of the control unit (DB- 
CTRL). tiie search unit (DB-SRCH) searches a finding data table of a chest X-ray examination which has not been 
made overall judgements of interpretation results fiudgements as to whether a dose examination is necessary or 
not), and reads out the examined person identification Information and the two doctors' diagnostic result informa- 
tion in the system memory of the control unit (DB-CTRL). 

(ii) The control unit (DB-CTRL) extracts the two doctors' diagnostic results of each examined person from the find- 
ing data table and the following comparison will be made: 

Case a: Both of tiie two diagnosed results are "normal". 

Case p: One of the diagnosed results is "abnormal", but the other "normal". 

Case y: Both of the two diagnosed results are "abnormal". 



A deciding metiiod of overall judgements can be selected.Select in the following. 

In tiie case a. the overall judgement is "normal". 

In the case p. tiie following two selections are available. 

(p-1): The overall .judgement is made as "abnormal". 
(p-2): The overall judgement is made as "normal". 

In tiie case g. tiie following two selections are available. 

(y-1): No operations are carried out and the overall judgement is made as "abnormal". 
(y-2): The diagnostic information in Section 5. Subsedion (4) is compared and classified for the position of 
abnormalities in the two finding data tables, namely compared and classified concerning the position of abnor- 
malities in accordance with the type of abnormalities. In this case, the overall judgement is made as "abnor- 
mal". 

(iii) In this embodiment, an operator inputs, from input unit (DB-INPUT) a command tor selecting the above-men- 
tioned operations (p-1) and (r-l) concurrentiy with a command of extracting persons to be made a dose examina- 
tion. Then, the overall judgements are transferred to the data storing unit (DB-STRG) and tiie search unft (DB- 
SRCH) con-esponding to the examined person identification information to be stored therein. 
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(3) Output of Interpretation Results 

[0240] The control unit (DB-CTRL) reads out the overall judgements from the data storing unit (DB-STRG). According 
to results of the overall judgement the following operations are available: 

5 [0241 ] When the overall judgement results are "nomfiat", the overall judgement results are written into the optical mag- 
netic disk corresponding to the examined person identification Information and the name of examined person. 
[0242] When the overall judgement results are "abnormal", the control unit (DB-CTRL) indicates the search unit (DB- 
SRCH) to search the image to be interpreted from the data storing unit (DB-STRG) to be read out. The two doctors* 
finding data table and overall judgements and the images to be interpreted are written into the optical magnetic disk cor- 

70 responding to the examined person identification information and the name of examined person. 
[0243] The optical nragnetlc disk is carried to a person to receive the report 

[0244] At this time, a flow of a series of system operations for interpreting the chest X-ray image in the lung cancer 

examination is completed. 

[0245] In this connection, the findings of the doctor's interpretation results and the CAD processing results are com- 
IB pared and classified and the classified results can be selected after the comparison, and a time of selection may before- 
hand be inoRcated before the interpretation or the time of selection may be indicated after interpreting a plurality of 
images, or the time of selectton may be fixed in a recommending form without selecting the time. 
[0246] When extracting the examined persons (to whom the close examination is required) in the database, the oper- 
ations after comparing a plurality of doctors' findings may be selected, and the time of selection may be carried out 
20 before inputting data into the database or at an Inputting time, or at a comparing time, or may be fixed in a recommend- 
ing form without selecting the time. 

[0247] In these second and third embodiments, a form of an elliptic set has been used as a method of displaying com- 
parison results, which is however not limited to its form, and any methods of varfous sets such as a rectangle etc., var- 
ious graphics such as a rod. a circle etc.. and an itemization can be used. 
25 [0248] Furthermore, in these embodimertts, the time of refenring to the CAD processing results was decided before a 
doctor inputs his/her findings, however the reference time is not limited to this time and the reference time may be 
decided after the doctor inputs his/her findings. 

[0249] Furthemore. in these embodiments, the operations on an off-line PACS have been described, however even 
the operations on an on-line PACS may be carried out without being limited to the off-line PACS. 

30 [0250] In these embodiments, the description on the medical images was made. These embodiments can be applied 
to medical examination data other than images, namely data having a graphic form such as an electrocardiogram, brain 
waves, or the like, or data arranged numerical values obtained by an automatic chemical analyzer etc. 
[0251 ] In these embodiments, the medical examination of a lung cancer was described in an example of the chest X- 
ray images, however this embodiment can be applied to a medical examination or a detection of an organ of a digestive 

35 system such as a stomach or the like other than a chest. 

[0252] As described above, as, in the present invention, it is unnecessary to indicate the images to be reinterpreted 
by the doctor every sheet of images and he/she has only to indicate the displayed set. the doctor can reduce his/her 
work amount Also, as the doctor can make use of the CAD at interpreting the images, it is possible to prevent the doc- 
tor's overlooks in a medical examination or the like. Furthermore, even if the doctor uses the CAD, his/her operation 

40 hours do not almost increase. 

[0253] As it is possible to distinguish the images diagnosed with reference to the CAD processing results from the 
images diagnosed after the doctor solely interprets them, the images diagnosed with reference to the CAD processing 
results can be removed when the doctor reinterprets the images, so that the interpreting time can be saved. 
[0254] In the medical group examination in the center etc., no persons has to work thereon, or at least their work 

45 amount can considerably be reduced. Also, the period from the medical examination to the examination result outputs 
can be shortened. 

Embodiment No. 4 

50 [0255] Hereinafter, a preferred embodiment (fourth embodiment] according to the third aspect of the present invention 
will be descrbed with reference to the accompanying drawings. In this embodiment, an example of performing a CAD 
by using a PACS will again be desalbed. First of all. the gist of the embodiment will be described and next a system 
configuration of the PACS is described and finally procedures of an interpretation by using the system of the present 
invention will be desalbed in detail. After the explanation on the system configuration of PACS, taken up ^ an example 

55 where a chest X-ray image is interpreted (read). 

[0256] Fig. 37 Is a flowchart for explaining the gist of the present invention. A digital image which is a species of med- 
ical examination data is inputted into the PACS from an image acquisition unit and stored in a database and can be sup- 
plied to a workstation as occasion demands. When interpreting, tiie digital image is first sent from the database to the 
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workstation. In Rg. 37, the CAD is applied to the digital image transmitted to the workstation and the digital image is 
CAD-processed to obtain its analyzing results 1 00. On the other hand, a doctor etc. interprets digital images and inputs 
its resultant findings 101. The interpreting finding 101 and the CAD processing result 100 about each disease are com- 
pared in detail (102), and in advance of the comparison, the images are classified into two categories: ones judged con- 

5 tents of the interpreting findings 101 as a normality (103): and ones diagnosed as an abnormality (104). The images 
diagnosed as a normality (1 03) are deemed as an object of the comparison 102 as it is. The images diagnosed as an 
abnormality (104) are first judged as to whether or not the images are existent within an objective scope (ROI) of the 
CAD processing (105). Its decided results can be outputted and displayed. When the images are existent within the 
objective scope (ROI;region of interest) of the CAD processing as a result of the judgement 105.. the comparison 102 

70 is made as it is. However, when the images are existent external to the objective scope (ROI) of the CAD processing as 
a result of the judgement 1 05, it is next judged as to whether the images are existent within or external to an applicable 
scope of the CAD processing (106). If the images are existent within the applicable scope of the CAD processing as a 
result of the judgement 106, the objective scope (ROI) of the CAD processing is automatically reset (107) and the 
images are CAD-processed once more to obtain its results 100. Also, if the images are existent external to the applica- 

is ble scope of the CAD processsing, the CAD does not make anything concerning this abnormality. Accordingly, doctor's 
Interpretation findings as it is are used conceming this abnormality (1 08). Then, in this case, the effect can be outputted 
and displayed. 

[0257] Thus-obtained CAD processing results 100 and the Interpretation findings (101 ) of a doctor etc. are compared 
in detail (102). By the comparison, the images are classified into two categories as to whether the CAD processing 

20 results 109 are consistent or inconsistent with the interpretation findings 101 of a doctor etc. (109). As a result of the 
classification 109, doctor's interpretation findings as it is are used conceming the consistent images (108). However, 
concerning the inconsistent images, the effect is displayed (1 10) to arouse attentions to an interpreting docta etc. The 
images displayed (110) are re-interpreted by a doctor etc. (1 1 1), and the interpretation findings are conrected if neces- 
sary (101) to complete the findings (112) containing the interpretation findings as it is (108). In this connection, it is 

25 shown that a part indicated by a broken line in tiie figure is not a major part in this novel embodiment. 

[0258] Next, an embodiment of a basic system configuration of the PACS will be shown in Fig. 1. This system com- 
prises various systems (subsystems) of: 

1) system manager (SN) 1 
30 2) image acquisition unit (lA) 2a. 2b 

3) database (DB) 3 

4) workstation (WS) 4 

5) network (NW) 5 

35 [0259] A network (NW) 5 is a transmission path between commands and data for communicating among respective 
units and an optical fflaer etc. is used as a transmission medium. The network (NW) 5 shown in Fig. 1 is a ring-type local 
area network, however the other types such as a star-type one or the like can be used. 

[0260] Each unit of a system manager (SM) 1 , an image acquisition unit (lA) 2, a database (DB) 3. and a workstation 
(WS) 4 is connected with the network (NW) 5. and these units have a communication protocol and can communicate 
40 each other through the network (NW) 5. 

[0261] The network (NW) 5 in the PACS is connected with an examination order system 7 for making examination 
request information through a gateway 6 and the examination request information is sent from the examination order 
system 7 to the system manager (SM) 1 in the PACS ttirough the gateway 6. 

[0262] The image acquisition unit (lA) 2 is a medical image acquisition unit for tiie PACS such as an X-ray machine. 
45 an X-ray CT machine, an MRI machine, a film digitizer or the like, and a plurality of image acquisition units (the same 
type of unit or the different type of unit) can be connected with one networt^ (NW) 5. 

[0263] The database (DB) 3 is a storage of a digital image created in the image acquisition unit (lA) 2 and is provided 
with a low-speed medium (optical disk etc.) or a high-speed medium (magnetic disk etc.). 
[0264] The workstation (WS) 4 appropriately processes digital images etc. sent from the database (DB) 3 or the 
so image acquisition unit (lA) 2 to obtain desired results and displays or outputs them. 

[0265] Next as to the respective units (subsystems) excluding the network (NW) 5. a function of the subsystems and 
its configuration element will be described. A film digitizer is picked up as the image acquisition unit (lA) 2. 
[0266] Main functions and acts of the system manager (SM) 1 will be desaibed. 

55 * The system manager (SM) 1 receives examination request infonmation from the examination order system 7 and 
issues an examination ID number. Types of data included in the examination request information received from the 
examination order system 7 are shown in Fig. 38. 
* The system manager (SM) 1 stores the examination request information and the examination ID number. 
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" The system manager (SM) 1 prepares examination histories of a patient and stores them. 

* The sy^em manager (SM) 1 stores interpretation reports. 

* The system manager (SM) 1 stores interpreting reference image preparation rule information and indicates the 
database (DB) 3 to prepare Images inside (readout from a low-speed medium to a high-speed medium) based on 
the information. 

[0267] The system manager (SM) 1 stores information as to which workstation (WS) 4 interprets and what kind of 
inspection is interpreted by the image, and the system manager (SM) 1 notifies each workstation (WS) 4 of what Idng 
of inspection is scheduled to be interpreted therein. 

[0268] A film digitizer serves as the image acquisition unit (lA) 2. and the main functions and acts therefor will be 
desaibed. 

* The film digitizer reads film concentration of, for example, an X-ray film and digitizes it to produce a digital image. 

* The film digitizer demands the system manager (SM) 1 to transfer the examination request information and 
receives the examination request information sent from the system manager (SM) 1, 

' The film digitizer inputs information attached to an examination or an Image to be displayed. 

* The film digitizer transfers image data and the information attached to an examination or an Image to the database 
(OB) 3. 

[0269] Main functions and acts of the database (DB) 3 will be described. 

The database (DB) 3 stores the image data and information attached to examination information and an image. 

* By an instruction from the system manager (SM) 1 . the image of the indicated examination Is read out from a low- 
speed medium (optical disk etc.) to a high-speed medium (magnetic disk etc.). 

* The database (DB) 3 supplies data to the other units as occasion demands. 

[0270] Main functions and acts of the workstaion (WS) 4 will first be described. 

* The workstation (WS) 4 can display examlnatbn request information, examination histories, images, an interpreta- 
tion report, and the like. 

* The workstation (WS) 4 can input newly aeated interpretation reports. 

* The workstation (WS) 4 processes for a computer-aided diag-nosis (CAD). This process is called a CAD process- 
ing. 

" The workstation (WS) 4 stores results of the CAD processing and compares the results with findings of the inputted 

interpretation reports for each interpretation point. 
" When the results of the CAD processing are different from the findings of the inputted Interpretation reports in the 

meaning, the workstation (WS) 4 outputs the effect. 

* When the results of the CAD processing indicate to be abnormal as to a certain interpretation point and the findings 
of the interpretation report as to the inteipretation point have not been inputted, the workstation (WS) 4 outputs the 
results of the CAD processing. 

" The workstation (WS) 4 outputs the results of the CAD processing in accordance with doctor's demands. 

* The workstation (WS) 4 creates a list of the image to be re-interpreted. 

[0271] Next a configuration element and a function of the workstation (WS) 4 will be described. Fig. 39 is a configu- 
rational diagram of the workstation (WS) 4. 

Control Unn(WS-CTRL) 

[0272] A control unit contains a central processing unit (CPU), a system memory (semiconductor memory), and the 
like and controls the entire operatton of the workstation. 

System Disk (WS-SD) 

[0273] This is a magnetic disk and stores programs or data such as: 

(a) a program for programing the workstation; 

(b) abnormality detecting means selecting information; 

(c) relating inf6rmatk)n of a ternporal change of an abnormality and a display color; 
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(d) relating information of an imaging direction of an image of a chest plain X-ray radiographing image and a relative 
display position; 

(e) an interpreting doctor s information taksle; and the like. These programs or data are read out when an electric 
power of the workstation (WS) 4 is turned on and written into system memories within the control unit (WS-CTRL). 

[0274] The abnormality detecting means selecting information of (b) is a table which corresponds a type of image (an 
examination portion, a modality, a medical examination m^hod, an imaging direction) to a type of an abnormality which 
can be detected in the image, and more specifically it is the data as shown in Fig. 40. The detectable data showing the 
type of an abnormality are used as data indicating the abnoramality detecting means for the CAD processing unit (WS- 
CADP). The abnormality detecting means selecting means can be rewritten. 

[0275] The relating information of a temporal change of an abnormality and a display color of (c) is information show- 
ing which color is displayed when the temporal change of an abnonnaiity is superimposed on the image to be displayed. 
[0276] The relating information of the imaging direction of the image of the chest plain X-ray radiographing image and 
the relative display position of (d) is information for deciding automatically a display position of an Image, and table data 
shown in Rg. 41 . The meaning of the decription of this table is as follows: 

"P -> A" indicates that X-rays irradiate from the back side of a patient and in this case, an image is a frontal one. 
"L -> R" indicates that X-rays irradiate from the left side of a patient and in this case, an image Is a right-sided one. 
"^R L" indicates that X-rays irradiate from the right side of a patient and in this case, an image is a left-sided one. 
C indicates to display In a center. 

L indicates to display on the left side of the image (frontal image) of T -> A". 
R indicates to display on the right side of the image (frontal image) of "P A". 

[0277] In this case, table data shown in Rg. 41 can be rewritten. 

[0278] The interpreting doctor's information is a table which con"esponds an interpreting doctor ID number to a name 
of an interpreting doctor, and table data as shown In Fig. 42. 

[0279] In this connection, when each of the above-mentfoned writable data is changed, a table relating to the data is 
displayed in a character display unit (WS-CDISP). and new data are inputted from the input unit (WS-INPUT) and the 
renewed data are ovenwritten on the pre-renewed data, whereby the data can be written. 

Input Unit (WS-INPUT) 

[0280] This is means for an operator's inputting information such as commands, interpretatfon reports, or the like, and 
a keyboard, a mouse, a touch screen, or the like is used. 

Character Display Unit (WS-CDISP) 

[0281 ] This is a unit for mainly displaying characters such as examination request information, examination histories, 
interpretation reports, or the like, and a CRT display, a liquid crystal panel display, or the like is used. 

CAD Processing Unit (WS-CADP) 

[0282] This contains image processing means for seeking a position where an abnormality of an Indicated type exists 
and a degree of an abnormality as to an indicated image, and memorizing means for memorizing results obtained by 
the CAD processing. The control unit (WS-CTRL) can read out results obtained by the CAD processing. 
[0283] The CAD processing unit (WS-CADP) contains means for detecting a plurality of types of an abnormality. That 

is: 

(a) means for detecting shadows of an interstitial lung disease in a frontal image of a chest plain X-ray image; 

(b) means for detecting shadows of pulmonary nodules in a frontal image of a chest plain X-ray image: and 

(c) means for detecting shadows of fine calcification of a breast in a breast X-ray image. These detecting means 
are disclosed in the following literatures:(l) Japanese Patent Application Laid-Open No. 2-185240: (2) Japanese 
Patent Application Ukl-Open Na 2-152443; and (3) Japanese Patent Application Laid-Open Na 1-125675. 

[0284] When two types of dala:(i) data showing a type of an abnormaOty to be detected; and (ii) image data are input- 
ted Into the CAD processing unit (WS-CADP). which analyzes image data by the indicated detecting means, and if 
detecting the abnormalities, the CAD processing unit (WS-CADP) seeks a position on the image and a degree of an 
abnormality and memorizes them in the inside memorizing means. 
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[0285] Alsa in a normal dissection structure a a region on an image diagnosis, by an indication of the control unit 
(WS-CTRL), its position or region is partially memorized in the inside memorizing means. A recognition of the normal 
dissection structure or the region on the image diagnoas is required to decide the region to detect an abnormality, and 
for example, by using a technique dfeclosed in Japanese Patent Application Laid-Open No. 1 -1 25675 (Japanese Patent 

5 Application No. 63-192171). a center line in the longitudinal direction of vertical Intervals, or a lower edge of the collar- 
bone, an upper edge of the diaphragm and a position of ribs of each right and left lung can be recognized. When, as to 
the ribs recognized, it is inputted what number of ribs a certain rib is, by recognizing successively that upper and lower 
ribs are the n-th ribs» it can be recognized that the position of the disease is between the n-th rib and the m-th rib and 
is one having a value of a relative distance from the vertical intervals (a value that a distance from the vertical intenals 

10 is divided by a distance behween the vertical intervals and a rib end). This can make a comparison with the different 
images, for example, the image in the past examination of the identical patient. 

[0286] The CAD processing unit (WS-CADP) seeks the absolute position or region of an abnomiality with a coordi- 
nate system in whfch an upper end and a left end of the image are the reference (the origin), and further the relative 
position or region of an abnomiality can be obtained based on the coordinate of the posi-tion of ribs by the following 
16 procedures: 

(0 To seek a position of a center line in the longitudinal direction of vertk^l intervals (the coordinate in the lateral 
direction) which is defined as a Y-axis. 

(ii) To seek a mean value of a position of an upper edge of the diaphragm of a right and left lung (the coodinate in 
20 the longitudinal direction), and a straight line perpendicular to the procedure (i) passing through the position is 

defined as an X-axis. 

(iii) To seek the coordinate by defining an intersecting point of two lines obtained by procedures (t) and (ii) as the 
origin. 

(iv) To recognize the number and positton of ribs which are obtained previously to seek the relative position among 
25 the ribs. 

(v) To add information of the relative position among the ribs to the absolute coordinate of an abnormality. 

[0287] Position data of the normal dissection structure are shown in Fig. 43. This shows an example of the coordinate 
of each rib with the coordinate system shown In the procedure (iH). 

30 

Image Data Unit (WS-IM) 

[0288] This is a unit for temporarily storing the following data and a magnetic disk: 

35 (a) Interpreting reference priority order information 

(b) Examination request information 

(c) Examination histories 

(d) Interpretation reports 

(e) Information attached to an image 
40 (f) Image data 

(g) Overlay display information 

(h) Abnormality data table 

(i) Temporal change data table of an abnormality 

45 Imaging Frame Memory (WS-IFM) 

[0289] This is a unit for temporarily memorizing a plurality of sheets of image data, and is a semiconductor memory, 
image Display Manager (WS-IDM) 

so 

[0290] This carries out operations for displaying an Image and an overlay. Fig. 21 Is a configurational diagram of the 
image display manager (WS-IDM) and a portion enclosed with a broken line is the image display manager (WS-IDM). 
This contains the following units: 

55 a) Control Portion 

This controls the entire configuration portion of the image display manager (WS-IDM). 
b) Overlay Data Malang Portion 

This makes overlay data (odor) from the overlay display information. 
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This contains means for displaying only data indicated in the overlay display information. 

c) Image Memory 

This memorizes image data. This has memories corresponding to a sheet of image (a matrix size is 2.048 x 
2.048 pixels). 

d) Overlay Memory 

This memorizes overlay data. 

As the overiay data are displayed in color, the overiay memory of one saeen is constructed of three sheets of 
overlay memory for red, green, and t)lue. As to the overlay memory for each color, conceptually a matrix size is 
2.048 X 2.048 pixels and a bH length of 1 pixel is 1 bit. 

The relationship between a display color and a bit value of each pixel is shovwi in Rg. 22. In Rg, 22, for exam- 
ple, as shown In step 10, assuming that a pixel value (a bit value of a pixel) on the pixel coordinate (X, Y) of the 
overlay memory for red is 1 and that a pixel value on the same coordinate of the overlay memory for both green and 
blue is 0, red is displayed on the coordinates. On the other hand, the display color; black means that any colors are 
not displayed, and when a color is displayed by siperimposing it on the image, only the image is displayed. 

e) Overlay Portion 

This superimposes Image data on overlay data. 

f) Displaying Memory (Memory for Storing Display Data) This memorizes display data. This image display manager 
(WS-IDM) has two sheets of displaying memory corresponding to a sheet of Image (a matrix size is 2.048 x 2.048 
pixels). 

This number is same as that of the image display unit (WS-IDISP). The displaying memory con-esponds to 
each image display unit (WS-iDISP). 

g) D/A Converter 

This converts display data from digital data to analog data. 

[0291 ] This corresponds to each image display unit (WS-IDISP) and is provided with the same number as the image 
display unit (WS-IDISP). 

[02921 The image display manager (WS-IDM) can receive the following information. 

(a) Type of data to be displayed 

There are three display types : an image only, an overlay only, the image and overiay combined. 

(b) Indicated information of the image display unit (WS-IDISP) displaying data 

(c) Overiay display information 

One graphic has a type of a graphic, a size of a graphic, a coordinate, a display color, control Infonnation of 
presence or absence of display (containing a flicker), or the like. 

(d) Image Data 

When an image overlapping an overlay is displayed, the foltowing operatfons are carried out: 

(1) The control portion 40 of the image display manager (WS-IDM) receives the following three Information 
from the control unit (WS-CTRL) of the workstation (WS) 4. 

(a) An "image and overlay" as a type of data to be displayed. 

(b) An image display unit number of the image display unit (WS-iDISP) displaying data. 

(c) Overlay display information 

(2) The image display manager (WS-IDM) receives image data and writes them into the image memory 42. 

(3) By an instruction of the control portion 40, the overlay data making unit 41 makes overlay data based on 
overlay display information and makes a specified graphic on a specified coordinate wHh specified cotor data. 

(4) By an instruction of the control unit 40. the image data and the overlay data are read out and inputted into 
the overiay 44 to synthesize the data. 

(5) The synthesized data are written into the displaying memory 45 of the indicated Image display unit number. 

(6) The synthesized data are converted into analog data by the D/A converter 46. 

[0293] The above-mentioned operations (4) to (6) are always repeated during the dispaly. 
[0294] Only when, as to a certain graphic on a coordinate, control information of presence or absence of a display 
(containing a flicker) indicates a "display", the overlay data making portion 41 writes the graphic into the overiay memory 
43 to display it. 

[0295] On the other hand, when the image is only displayed, in the operation (1), the control portion 41 receives: 
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(a) an "image only" as a type of data to be displayed; and 

(b) an image display unit number of tlie image display unit displaying data, and does not receive the overlay display 
information. In the above-mentioned operation (4), the overlay data is not read out, accoidingiy the image data are 
not superimposed on the overlay data. 

Infiage Display UnH (WS-IDISP) 

[0296] This is a unit for mainly displaying an image and can display an image of which a matrix size is 2,04a x 2,048 
pixels. This embodiment has two units. 

Network Interfece (WS-NWIF) 

[0297] This is an interfece with the network (NW) 5 and is used to communicate with the other subsystems through 
itself. 

Control Bus(WS-CBUS) 

[0298] This is a transmission path of various control information within the workstation (WS) 4. 
Image Bus (WS-IBUS) 

[0299] This is a transmission path of the image data and the overlay data within the workstation (WS) 4. 
[0300] In this connection, a clock for refenring to a date and a time (not shown) is integral with the worstation (WS) 4. 
[0301] Thus-constructed PACS is used and a flow of a series of system operations when interpreting an Image by 
applying the present Invention thereto will be described. For example, the interpretation of a chest X-ray image is used 
in the course of explanation. After the image data are sent from the database (DB) 3 or the image acquisition unit (lA) 
2 to the workstation (WS) 4, in the workstation (WS) 4. in the order of: 

1 . a preparation of an Image for interpreting; 

2. a production of the CAD processing and the diagnosis information; 

3. an interpretation of an image by an interpreting doctor and inputs of an interpretation report; 

4. a conparison of the diagnosis information and an arousal of attentions to the interpreting doctor; 

5. reference of the CAD processing results by the interpreting doctor and a re-interpretatbn; and 

6. a completion of the interpretation report and its storage, a series of system operations is carried out. 

[0302] The information sent from the database (DB) 3. the image acquisition unit (lA) 2. or the system manager (SM) 
1 to the workstation (WS) 4 is as follows: 

(a) Chest X-ray image (frontal image) 

(b) Examination ID number and patient ID number 

(c) Examination request information, examination conditions (radiographing conditions, radiographing method) 

(d) Hearing infbrmatk>n(e) Previous Image 

[0303] This is the image that a patient has previously been examined. 

[0304] Hereinafter, the above-mentioned series of system operations will be described in detail. 

1. Preparation of Image for Interpreting 

(1 -1 ) Data transmission from the system manager (SM) 1 

[0305] The system manager (SM) l sends data concerning the examination request information (in this case, the 
examination ID number is 1 03541 and the patient ID number is 870802). the examination history data of the patient, the 
interpreting reference priority order information (refening to Rg. 44), and the interpretation report of previous examina- 
tion of tiie patient (in this case, three medical examinations) to the workstation WS-1 . 
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(1-2) Storage of data from tfie system manager (SM) 1 of the wortetation WS-1 
[0306] 

(1-2-1) When the data are sent from the system manager (SM) 1 to the network interface (WS-NWIF) of the work- 
station WS-1. the control unit (WS-CTRL) of the workstation WS-1 reads out the received data from the network 
interface (WS-NWIF) and writes the data into the system memory wrthin the control unit (WS-CTRL). 
(1 -2-2) The control unit (WS-CTRL) writes the data concerning the examination request information, the examina- 
tion history data, the Interpreting reference priority order infornratlon. and the Interpretation report of the previous 
examination of the patient into the image data unit (WS-IM). 

(1-3) Image transfer demand to the database (DB) 3 

[0307] 

(1-3-1) The control unit (WS-CTRL) of the worstation WS-1 refers to the interpreting reference priority order infor- 
mation and transfers the examination ID number of the examination having the minimum reference priority order 
number to the network interface (WS-NWIf=) and indicates an image transfer demand to the database (DB) 3. The 
network interface (WS-NWIF) sends the assigned examination ID number and an Image demand command to the 
database (DB) 3. 

(1 -3-2) The database (DB) 3 receives this demand and reads out the image data and the information attached to 
an image from the inside memories and sends the data to the workstation WS-1 . 

(1-3-3) When the image data and the information attached to an image are sent from the database (DB) 3 to the 
network interface (WS-NWIF) of the workstaion WS-1 . the control unit (WS-CTRL) of the workstation WS-1 reads 
out the received data from the network interface (WS-NWIF) and writes them into the image data unit (WS-IM). 

(1 -4) Image transfer demand of the previous examinatbn to the database (DB) 3 

[0308] The control unit (WS-CTRL) of the workstation WS-.1 demands the database (DB) to transfer the image data 
and the information attached to an image concerning the other examinations included in the Interpreting reference pri- 
ority order information according to the above-described same procedures, and writes the date Into the image data unit 
(WS-IM). As the image transfer demand to the database (DB) 3 is carried out in order of the minimum reference priority 
order number, the image data and the information attached to an image concerning the images of the prevfous exami- 
nation are available in the order of the examination ID numbers 100902^ 102287. and 60563. 

2. Production of CAD Processing and Diagnosis Information 

(2-1) CAD processing The workstation performs the CAD processing 

[0309] concerning images to which the CAD processing can be applied to all received images. This CAD processing 
Is performed before an interpretatfon of a doctor etc. 

(2-1 -1 ) The control unit (WS-CTRL) of the workstation WS-1 refers to abnormality detecting means selection infor- 
mation (refer to Rg. 40) concerning respective images of the examinatfon to be interpreted (the examination ID 
number is 103541), and judges as to whether the CAD processing can be applied or not That is, the control unit 
(WS-CTRL) investigates as to whether or not a name of an examined portion, a name of a modality, and a combi- 
nation of an examination method included in the examination information data are existent within the abnormality 
detecting means selection information. As to the examination of the examination ID number 103541, the image Is 
frontal and the CAD processing can be applied to it Then, the type of a detectable abnormality is two types of the 
pulmonary nodules and interstitial lung disease. If the abnormality detecting means is not within the abnormality 
detecting means selection information, the control unit (WS-CTRL) of the wori«tation WS-1 moves into the 
processing of tiie next image. 

(2-1 -2) The control (WS-CTRL) of the workstation WS-1 reads out the image of the examination of the examination 
ID number 103541 from the image data unit (WS-IM), and inputs the image into the CAD processing unit (WS- 
CADP) together with data meaning a detectfon instruction of the "pulmonary nodules". The CAD processing unit 
(WS-CADP) acts the pulmonary nodule detecting means for the inputted image data and analyzes the image data. 
The scope to be CAD-processed in tiiis analysis is applied to the entire image. In the abnormalities, as shown in 
Rg. 45, Z1 and 22 are detected. 
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(2-1 -3) The control unit (WS-CTRL) o1 the woitetation WS-1 reads out the image of the examination of the ©ami- 
nation ID number 103541 from the image data unit (WS-IM). and inputs the in^ge into the CAD processing unit 
(WS-CADP) together with data meaning a detection Instruction of the "interstitial lung disease". Also, the control 
unit (WS-CTRL) indicates to output a position of a normal dissection structure. H one number of n*bs is inputted into 
this, a relative position among ribs in the detected abnormality position is obtained. This is necessary when the 
image is compared with the previous image. 

The CAD processing unit (WS-CADP) activates the interstitial lung disease detecting means for the inputted 
image data and analyzes the image data. In this analysis, the following method is taken. Namely, a region of inter- 
est (ROI) is set among ribs as an analyzaWe scope to be CAD-processed within a dotted line region as shown in 
Fig. 46. namely within an applicable scope of the CAD processing, and an abnormality is detected by analyzing the 
region of interest (ROI). In this case, the scope to be CAD-processed is limited. The conditions in which the region 
of interest (ROI) is set are shown in Fig. 46. 

This scope to be CAD-processed is analyzed. As a result of the analysis, a judgement of an "abnormality" or 
a -normality" is given to each region of interest (ROI), The results of tiie analysis are shown in Fig. 47. As a result 
of the analysis, as to ROM . R0I2, R0I3. and R0I19 which are judged as an "abnonnalrty", if the analysis results of 
the adjoining ROI are "abnormal", it is deemed that the abnomiality distributes uniformly Accordingly, the ROM, 
R0I2, or R0I3 is one of abnormalities distributing widely and the abnormal region is a region Y1 in which an area 
coupling respective vertexes of the ROM, R0I2. and R0I3 is tiie maximum as shown in Rg. 48. On the other hand, 
as the ROMS. R0I17. R0I18. RO120 and R0I21 adjacent to the R0I19 are judged as a "normality", the abnormal 
region Y2 is the R0I1 9 itself. As a result of the analysis, data of the okstained abnormal region and data of a position 
of a normal dissection structure are memorized in memories within the CAD processing unit (WS-CADP). 
{2-1 -4) The control unit (WS-CTRL) of the workstation WS-1 investigates, in the same manner as desaibed above, 
as to whether or not the abnormality detecting means can be applied to the examination image of the other exam- 
ination ID numbers, and if so, the abnormalities are detected as to the entire abnormality detecting means to be 
applied by making use of the CAD processing unit (WS-CADP). Also, the control unit (WS-CTRL) seeks a position 
of the normal dissection structure just once as to each image to be CAD-processed. 

[031 0] At tills time, data representing a position of an abnormality which is memorized in memories integrated with 
the CAD processing unit (WS-CADP) are shown in Rg. 49. The position of an abnormaity has an absolute position 
coordinate defining an upper left end of an image as the origin and a relative position among ribs using vertical inten/als 
and ribs (refer to Fig. 43), however the absolute position coordinate only is shown in Fig. 49. The data shown in Fig. 49 
are called an abnormality data table for clarity. Also, it can be decided which position (among ribs) a certain abnormality 
exists by using the position data of tfie nomial dissection structure of n"bs shown In Rg. 43. This is because the abnor- 
mality is detected only in a pulmonary field on the image. The data shown in Rg. 43 is called a position data table for 
clarity. In tWs connection, as seen from a viewpoint of Figs. 43 and 49, a coordinate transformation Is required in order 
to correspond to each other. This is because the coordinate system shown in Fig. 43 is not the above-mentioned abso- 
lute position coordinate system. 

(2-2) Decision of ttie normal dissective position (relative position among ribs) where an abnormality exists 

[031 1 ] This decides as to whether or not the detected abnormality is existent between the n-th rib and tiie m-th rib, 
and the control unit (WS-CTRL) of the workstation WS-1 refers to position data of the normal dissection structure 
Included in the position data table each data included In the abnormality data table, and judges which position of the 
normal dissection structure the abnomial position is included in. The data showing the position of each rib are written 
into the abnormality data table. In this case, the position data shown in Fig. 43 are converted into the above-mentioned 
absolute position coordinate system. 

[031 2] After the abnorn^lity data table is read out from tiie Inside memory of the CAD processing unit (WS-CADP) 
to the system memory of the control unit (WS-CTRL). it is processed with the following procedures and the renewed 
abnormality data table is written into tiie image data unit (WS-IM). 

(a) To extract data of tfie position data table as to a certain abnormality in which an examination ID number of an 
image detecting the atxiormality coincides with an image number. 

(b) A lateral coordinate of an abnormality position is compared with a lateral coordinate of a center line (mediasti- 
num) of right and left lungs, and if a lateral coordinate of the abnomiality position is smaller than a lateral coordinate 
of a center line (mediastinum) of the right and left lungs, a right lung field is detemiined to be abnormal, and if ttie 
former is larger than the latter, a left lung field is determined to be abnormal. 

In this enr*odiment an object of a frontal image is only an image radiographed by irracfiating X-rays from the 
back of a patient, and this is because, in the case, the left side of the image is a right lung field and the right side 
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thereof is a left lung field. In this connection, the iniage radiographed by irradiating X-rays from the front side of a 
patient is also a frontal image and can be treated. In this case, data of "A -> P" are used as the imaging direction 
and the position of the right lung field is reverse to that of the left lung field. This can be judged by referring to data 
of the imaging direction exfeting in information attached to an image. 

(c) In the lateral coordinate of the position of an abnormality, the longitudinal coordinate of the position of the abnor- 
mality is compared with the longitudinal coordinate of the fourth rib. and if the longitudinal coordinate of the position 
of the abnormality is smaller than that of the fourth rib, the position of the abnormality is decided to be on the fourth 
rib and proceed to step (e). If the longitudinal coordinate of the position of the abnormality is greater or equal, pro- 
ceed to the next step. 

(d) In the lateral coordinate of the position of an abnormality, the longitudinal coordinate of the position of the abnor- 
mality is compared with that of a rib directly under the rib compared at the last time, and if the longitudinal coordi- 
nate of the position of the abnormality is smaller, the position of the abnormality is decided to be between the rib 
compared at the last time and the rib compared at this time and proceed to step (e). 

Until the position of the abnormality is interposed between any ribs, repeat step (d). 

(e) The lateral coordinate of the position of an abnormality is divided by the lateral coordinate of a rib end to com- 
pute a ratio of the position in a lung field. 

(f) The decided relative position data between the right and left lungs and the rib are connected with the position of 
an abnormality to write the data into the abnomiality data table. 

[031 3] The above-mentioned procedures are candied out as to the entire abnormality in the abnormality data table. An 
example of the abnormality data table after the procedures are corrpieted Is shown in Fig. 50. This Is the necessary 
procedures for making a quantitative comparison of the previous image, and by making a quantitative comparison with 
the previous image, a temporal change of the abnormality is recognized, thereby making a temporal change data table 
of the abnormality. However, when two diagnostic information concerning the Identical image is simply compared, it is 
sufficient if only the absolute position coordinate (data) is prepared, and the above-mentioned procedures are unnec- 
essary. 

(2-3) Production of overlay display information to display an abnormality 

[0314] In a production of overlay display information showing the detected results of an abnormality on each image, 
the control unit (WS-CTRL) of the workstation WS-1 refers to the abnormality data table (Fig. 49 or Fig. 50) and pro- 
duces the overlay display information to show a position of an abnormality (Rg. 51), and the produced overtay data are 
stored in tiie image data unit (WS-IM). The position of the abnormality is expressed witii a graphic such as an arrow 
etc. Also, a color of an arrow is red and the following procedures are carried out: 

(a) The control unit (WS-CTRL) of the workstation WS-1 reads data of the position of an abnormality on an image 
as to tiie abnormality having the reference number 1 in ttie abnormal data table. As to ttie data number 1 of ttie 
overiay display information, a type of a graphic is written as an "an-ow". 

An absolute position coordinate is written as a coordinate. 
Also, a type of a graphic is different accoiding to types of disease. 

(b) A display color is decided to be red. "Red" is written as a display color. 

(c) As to control information of presence or absence of a display, a "display" is written in this stage. 

(d) As to abnormalities of tiie other reference numbers, ttie procedures are carried out in tiie same manner as the 
procedures (a) to (c). However, as an overlay is superimposed on an image to be displayed, the identical overlay 
display information data are written only in an abnormality that ttie examination ID number coincides with the image 
number. 

(e) The control unit (WS-CTRL) of ttie workstation WS-1 stores ttie produced overlay display information in ttie 
image data unit (WS-IM) corresponding to ttie examination ID number and tiie image nunt>er. 

so [0315] Fig. 51 is an example of ttie thus-produced overlay display information. 

3. Interpreting Doctor's Interpretation of Images and Inputs of tfie Interpretation Report 

[0316] Generally, images of a plurality of patients are prepared in ttie workstation. When an interpreting doctor inter- 
55 prets (reads) images, ttie doctor is ordinarily indifferent to a priority of interpreting an image of a patient. Therefore, as 
the doctor interprets from ttie older date of examination in an examination to be interpreted or In tiie sequential order of 
an examination ID number, ttie workstation automatically decides the order. 
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(3-1) Data display for an interpretation of an image 
(3-M) Preparation of data 
5 [031 7] Initialty. data are prepared in the following procedures: 

(a) Readout of examination requeat information 

The control unit (WS-CTRL) of the workstation WS-1 reads out an examination ID number, a patient ID 
number, and an examination request information from the Image data unit (WS-IM) and writes them into the system 
10 memory within the control unit (WS-CTRL). 

(b) Readout of examination histories 

The control unit (WS-CTRL) of the workstation WS-1 reads out examination history data having the patient ID 
number 870802 from the image data unit (WS-IM) and writes them into the system memory within the control unit 
(WS-CTRL). 

IS (c) Readout of information attached to an image and image data 

The control unit (WS-CTRL) of the workstation WS-1 refers to interpreting reference priority order information 
(refer to Ftg. 44) and reads out the information attached to an image on the entire image (refer to Fig. 52. in this 
case, a sheet of image) as to the examination ID number having the priority order 0 which is interpreted in this case, 
from the Image data unit (WS-IM), and writes It into the system memory within the control unit (WS-CTRL). 

20 Next, the control unit (WS-CTRL) succesively reads out the information attached to an image on the entire 

image as to the examination ID numtjers (100902, 102287, 50563, re^ectively) having the priority orders 1, 2, 3 
and writes them into the system memory within the control unit (WS-CTRL). 

(d) Readout of an interpretation report 

The control unit (WS-CTRL) of the workstation WS-1 refers to interpreting reference priority order information 
25 (refer to Fig. 44) and reads out a format of the interpretation report as to the examination ID number (in this case, 
103541) having the priority order 0 which is interpreted in this case, and the interpretaton report of the previous 
examination in the sequential order of the priority order number as to the other examination ID numbers, from the 
image data unit (WS-IM), and writes them into the system memory within the control unit (WS-CTRL). 

(e) Readout of the abnormality data table 

30 The control unit (WS-CTRLJ of the workstation WS-1 reads out the previously created abnormality data table 

(refer to Rg. 49) from the Image data unit (WS-IM). and writes it Into the system memory within the control unit 
(WS-CTRL). 

(f) Readout of the overlay display information to display detection results of an abnormality on an image 

The control unit (WS-CTRL) of the workstation WS-1 refers to the abnormality data table memorized in the sys- 
35 tern memory and reads out the overlay display Inforniation to show detection results of an abnormality memorized 
corresponding to a combination of the examination ID number and the image number, from the image data unit 
(WS-IM), and writes it into the system memory within the control unit (WS-CTRL). 

[0318] In this case, the overlay display information corresponding to the examination ID number 103541 and the 
40 image number 1 is read out. (3-1 -2) Display of an image 

[031 9] TTie workstation WS-1 displays an image of an examination to be interpreted. Now. as two image display units 
(WS-IDISP) are provided, the workstation WS-1 automatically displays a sheet of image of an examination to be inter- 
preted (the examination ID number 103541). The display is made according to the fbUowing procedures: 

45 (a) The control unit (WS-CTRL) of the workstation WS-1 first acknowledges an imaging direction from the informa- 
tion attached to an image of a sheet of image having the examination ID number 103541 (refer to Fig. 52). As it is 
"P -> A", the Image is frontal. 

(b) The control unit (WS-CTRL) decides the Imaging direction checking with a relation information table (referring 
to Fig. 41) of the imaging direction of the image of a chest plain X-ray image and a relative display position. 
so (c) Thus, the left-sided image display unit of the two Image display units (WS-IDISP) ananged laterally displays the 
image (frontal image) in the image direction "P -> A". 

(3-1-3) Display of examination request information 

55 [0320] The control unit (WS-CTRL) of the workstation WS-1 selects specified data such as an examination object, 
clinical Information, a disease name diseased previously to a patient, and the like, out of the examination request infor- 
mation read out previously into the system memory, and writes them into the character display unit (WS-CDISP). 
[0321 ] An interpreting (reading) doctor reads the displayed image. 
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[0322] When displaying images other than the displayed image or interpretation reports, the doctor inputs commands 
fa them from the Input unit (WS-INPUT). (3-2) Inputs of an interpretation report l)y an interpreting (reading) doctor 
[0323] After a doctor completes interpreting an image, he/she inputs an interpretation report into the workstation WS- 
1 . The input unit (WS-INPUT) for inputs and the character display unit (WS-CDISP) for displaying are used. The inter- 
pretation reports are inputted by selecting a word, a phrase, or a sentense. and indicating a position of an abnormality 
on an image with a mouse, or enclosing a region of the abnwmaltty on the image wHh a dosed curved line with a 
mouse. When the interpreting doctor inputs the position of the abnorrmlity or the region of the abnornwlity with a 
mouse etc., the control unit (WS-CTRL) of the workstation WS-1 sends this infonnation to the image display manager 
(WS-IDM) to aeate an overlay. In this overlay, the position of the abnormality is shown by a white arrow and each type 
of Ihe abnormality is displayed assigning a number. TTie place or the aspect of the abnormality on the image can be 
recognized by the overlay. Thus, the obtained image Is shown in Fig. 53. In this connection, the word, phrase, or sen- 
tense to be selected has previously been registered in the system disk (WS-SD) of the wori^tation WS-1 . and this dic- 
tionary is used in common on the entire system. 

(3-2-1) Display of an interpretation report creating screen 

[0324] When an interpreting doctor inputs an interpretation report creating command from the irput unit (WS-INPUT) 
of the workstation WS-1, the control unit (WS-CTRL) of the workstation WS-1 displays a format of the interpretation 
report on the character display unit (WS-CDISP). The format of the interpretation report which is displayed on a screen 
of the character display unit (WS-CDISP) is shown in Rg. 54. In Rg. 54. the region enclosed with a dotted line is one 
for displaying the word, phase, or sentense to be selected by the interpreting doctor (3-2-2) Inputs off an interpretation 
report 

[0325] An Interpreting doctor inputs the following three items as to each finding according to the format of the inter- 
pretation report displayed: 

A type of an abnormality 

A number in which an abnormality is pointed out in an image 
A position and a region in which an abnormality exists 

[0326] A method of inputting a position or a region of an abnormality is different in a type (disease) of the abnormality. 
Because pulmonary nodules are detected as circular shadows having a diameter from 5 mm to several cm. or an inter- 
stitial lung disease distributes within a wide scope of a lung field. The position of the abnormality like the pulmonary 
nodules is inputted by pointing out the position of the abnormality on the image with a mouse, and the region of the 
abnormality like the interstitial lung disease Is inputted by enclosing a scope where the abnormalities distribute with a 
closed curved line by using a mouse etc. The Indicated position or region is memorized corresponding to the indicated 
abnormality. The control unit (WS-CTRL) of the workstation WS-1 displays the inputted data in a specified position on 
a screen and also memorizes them into the system memory corresponding to the finding number. 
[0327] When the finding has been finished inputting, a conclusion will be inputted. Then, the interpreting doctor inputs 
an input completing command of the inteipretation report from the input unit (WS-INPUT). 

(3-2-3) 

[0328] Referring to Rgs. 58 and 59, there will be shown an example for voice input plus position input. 

[0329] A doctor interprets an image, and indicates a abnormality location with pointing means such as a mouse while 

speaking his remarks to voice input means such as a microphone. 

[0330] The voice is recognized by voice recognizing means so that a name of disease is extracted from the doctor's 
voice. Thereafter, the location specified by the pointing means Is conresponded to the name of disease extracted so that 
a doctor's remarks (findings) are made to be stored. 

(3-2-4) 

[0331 ] Referring to Rgs. 60 and 61 . there is shown an example for reading of the characters or the like. 
[0332] A doctor writes an abnormality position and remarks (findings) In report paper of a specified form. The report 
paper is inputted to character reading means and the like so as to read the abnormality location and the name of dis- 
ease Thereafter, the abnormality location is conresponded to tiie name of disease so as to be stored as the doctor's 
remarks (finding). 

[0333] It is to be noted that a word, phrase or sentence concerning the type of abnormality or so on may be inputted 
directly from a keyboard by the doctor. 
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4. Comparison of Diagnosis Information and Arousal off Attentions to Interpreting Doctor 
(4-1) Extraction of findings to be compared from the interpretation report 

[0334] Findings to t>e compared with diagosis information okAained from the CAD processing results (an abnormality 
data table etc.) will be extracted from the findings of Interpretation reports. The control unit (WS-CTRL) of the worksta- 
tion WS-1 Investigates as to whether or not the following combination is existent in the abnormality detecting means 
selecting information (refer to Fig. 40) as to respective findings of the interpretation reports: 

A type of an abnormality (existing in the finding of an interpretation report) 

An examination portion of an examination to be Interpreted (existing in the examination history) 

A modality (existing in the examination history) 

An examination method (existing in the examination history) 

An imaging direction of an Image (which is one concerning an image number in an examination to be interpreted 
in a finding of an interpretation report and which is existent in information attached to an image) 

(4-2) Comparison between the interpretation report and the abnormality data table 

[0335] 

(4-2-1) The control unit (WS-CTRL) of the wakstation WS-1 compares the abnormality con-esponding to the find- 
ing with each abnormality off the abnormality data table as to the following four sets of data concerning the respec- 
tive findings of the Interpretation reports attracted in Section 4, Subsection (4-1), and extracts each abnormality of 
the abnormality data table in which the four sets coincident with each other: 

An examination ID number of an examination to be interpreted (which is not described in a finding off an inter- 
pretation report and which is existent in information attached to an image). 

An image number in an examination to be interpreted (which is not desaibed in the finding or remarks off the 
reading report and which is existent in data attached to the image) 
A type of an abnormality 

A posltton and a region in which an abnormality exists 
[0336] Hereinafter, procedures off a comparison of four sets of data will be described in detail. 

(a) A finding having the identical examination ID number and the image number and an abnormality data table will 
be extracted. In this embodiment, based on the examination ID number 103541 and the image number 1 concern- 
ing the image to be interpreted, the abnormality data table which is the results analyzed concerning ttiis image 
(refer to Figs. 49 and 50) will be extracted. 

(b) The control unit (WS-CTRL) reads as to whether the doctor's Interpretation results are "abnormal" or "nonnar 
from the finding (in which anything has not been desaibed). and compares them with the abnormality data table. 
(b-1) When the doctor's interpretation results are "normal" and the results of the CAD processing are "normal" 
(anything has not been decribed in the abnormality data table), the Interpreting results are deemed to coincide with 
those of the CAD process-ing as to this combination. 

When the doctor's interpretation results are "abnormal" or the results of the CAD processing are "abnamal", 
the following processing will be earned out 

(b-2) Concerning the abnormality pointed out by the doctor and the abnormality detected by the CAD processing, 
a position and a region as to the same type of the abnormality are compared. 

In this embodiment, as shown in Fig. 55. when referring to the finding number 1, it is pulmonary nodules, and 
when referring to finding numbers 2, 3, and 4, they are interstitial lung diseases. On the contrary, when referring to 
the abnormality data fable (refer to Figs. 49 and 50) which shows ttie results off ttie CAD processing, ttiese diseases 
were detected. Accordingly, the respective ffindings are compared with the results of the CAD processing as to each 
disease. 

(i) A comparison is made as to the pulmonary nodules A1 off the fflnding number 1 . As the pulmonary nodules 
were explained in Section 2. Subsection (2-1 -2). a scope to be CAD-processed is the entire image. Also, as a 
matter off course, a scope to be interpreted by the doctor is the entire image. Herein, the method of indicating 
a position of an abnomial ity by the doctor is same as that by the CAD to be displayed by an arrow. Accordingly, 
if the position off an abnormality is on the coordinate of an arrow tip. as shown in Rgs. 56 and 57. ttie abnor- 
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mality A1 of the finding number 1 is (1 500. 1300). and abnormalities Z1 and Z2 detected as the results of the 
CAD processing are respectively Z1 (1450. 1350). 22 (500. 1300). 

If a dfetance between the abnormality A1 indicated by the doctor and the abnormalities Z1 and 22 detected by 
5 the CAD processing is less than a specific value AO (»1 00), the position of the identical abnormality shall be pointed 
out. 

Comparison of A1 to Z1: V {(1500 - 1450)^ + (1300 - 1350)^) = 71 < 100 

'0 Comparison of A1 to 22: V {(1500 - 500) ^ + (1300 • 1300) ^} = 1000 > 100 

Accordingly, the idetical abnormality is pointed out by A1 and Z1 and it is recognized that 22 is detected by the 
CAD but is not pointed out by the doctor, (ii) A comparison among the interstitial lung diseases B1, B2, and B3 of 
the finding numbers 2, 3, and 4 is made. In the interstitial lung disease, the doctor shows the position of the abnor- 

is mality with a closed curved line and the CAD processing results show it with the region enclosed with a straight line 
(refer to Figs. 48 and 49). Herein, the scope to be CAD-processed in the interstitial lung disease is not the entire 
image as shown In Section 2. Subsection (2-1 -3) (refer to Fig. 48). but is limited. Also, the scope to be interpreted 
by the doctor extends to the entire image. Accordingly, it is investigated from the coordinate of each region of inter- 
est (ROI) as to whether or not the region of the abnormality to be pointed out by the doctor is existent within the 

20 scope to be CAD-processed, or namely whether or not the region of interest (ROI) is existent within the region of 
the abnormality to be pointed out by the doctor. As a result, in the case where the region of interest (ROI) is existent 
within the region of the abnormality pointed out by the doctor (case 1), a conparlson of a distance among the 
regions is made as described below. On the other hand, in the case where the region of interest (ROI) is not exist- 
ent within the region of the abnormality pointed out by the doctor, this case is divided into the following two cases: 

25 In the case where the region of interest (ROI) is not existent within the region of the abnormality pointed out by the 
doctor, and is without the applicable scope of the CAD processing (case 2), and in the case where the region of 
interest (ROI) Is not existent within the region of the abnormality pointed out by the doctor, but is within the applica- 
ble scope of the CAD processing (case 3). In the last case 3. the CAD processing unit (WS-CADP) automatically 
resets the region of interest (ROI) and carries out the CAD processing again to analyze the region of interest (ROI) 

30 and repeats from the Initial stage of Subsection (b-2), (ii). In this connection, the results of these judgements are 
memorized in the system memory of the control unit (WS-CTRL) and will be able to be outputted as occasion 
demands. 

When the finding in this emlxxJiment is applied to each case, as three ROIs from the ROM to the R0I3 exist 
wHhin the region B1 , this finding Is the case 1 . and as the ROI does not exist within the region B2 and is without the 

35 applicable scope of the CAD processing, this finding is the case 2. In the case of this case 2, the CAD processing 
unit (WS-CADP) does not carry out anything concerning this region of the abnormality. Furthermore, as the ROI 
does not exist within the region B3, but is within the applicable scope of the CAD processing, the CAD processing 
unit (WS-CADP) automatically resets the ROI within the region B3 and carries out the CAD processing again to 
analyze the ROI. Then, in this embocfiment. the CAD processing is carried out again, so that the ROI shall be 

<o judged as no abnormalities. Accordingly, as the results of the CAD processing, the detected re^ons of the abnor- 
mality are only Yl and Y2. 

Next, a comparison is made as to each region shown as an abnormality. For the comparison, a distance among 
respective regions is defined as a distance among respective centers of the gravity of the regions. That is. in the 
same case as the pulmonary nodules, if the distance among respective centers of the gravity Is less than a specific 

45 value, say. BO (=300). the identical region of the abnormality shall be pointed out. 

The below-mentioned case is that the region is judged as an abnormality as the results of the CAD processing, 
or tiiat the doctor judges as an abnormality and the region is within the applicable scope of the CAD processing 
(accordingly, excluding the region B2). Then, tiie center of the gravity in the respective regions is seeked to com- 
pute the coordinate. As shown In Figs. 23 and 24. each center of the gravity in the regions Is shown with a black 

so round and the coordinates of the position are seeked as B1 (600. 720). B3 (500. 1300). Yl (610. 710). and Y2 
(1700. 1300). 

Comparison of B1 to Yl: V {(600 - 610) ^ + (720 - 710) ^} = 14 < 300 
S5 Comparison of B1 to Y2: V {(600 - 1700)^ + (720 - 1300)^) = 1243 > 300 

Accordingly, the B1 and Yl are judged to show tiie identical abnormality. 
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comparison ot B3 to Y1: V {(500 - 610)* + (1300 - 710)") = 600 > 300 
Comparison of 83 to Y2: V {(500 - 1700) ^ + (1300 - 1300)^} = 1200 > 300 

Accordingly, rt is judged that the CAD processing results detecting B3 do not exist and the doctor's findings 
coinciding with the CAD processing results Y2 do not exist. 

(M) In this stage, in the case where, as to ail the findings extracted in Section 4. Sul)section (4-1) and all the 
abnormalities in the abnomiality data table, the coincident data exists, it is judged that the interpreting doctor's find- 
ings coincide with the results of the CAD processing, and the information of presence or absence of the display of 
the overiay display information is written from a "display- to a "non-display". Then, the succeeding steps will not be 
executed. Corresponding to the cases of B1 and Y1 in this embodiment. 

[0337] Thus, in the case where the Interpreting doctor's findings coincide with the results of the CAD processing, the 
interpreting doctor's findings as it is are acceptable. 

(4-3) Arousal of attentions to the interpreting doctor based on the conrparative results 

[0338] As the results of the above-mentioned comparison, if the findings having no coincident data or the abnormal- 
ities of the abnormality data table exist, it is judged as to them that the interpreting doctor's findings are different from 
the results of the CAD processing, and attentions to the interpreting doctor are aroused. As the case where the inter- 
preting doctors findings are different from the results of the CAD processing, the follow-Ing two cases are existent: 

Case 1 : An interpreting doctor judges as a normality (no findings), but the CAD detects as an abnormality. 
Case 2: An interpreting doctor judges as an abnormality, but the CAD cannot detect as an abnommlity. 

[0339] The control unit (WS-CTRL) of the workstation WS-1 reads out the findings of the interpretation report having 
no coincident data and abnormalities of the abnormality data table from the interpretation reports and the abnomiality 
data tables to memorize them in the system memory. 

(4-3-1) The control unit (WS-CTRL) of the workstatfon WS-1 executes the following procedures in the case where 
the abnormality data belonging to the above-mentioned case 1 exist: 

(a) The control unit (WS-CTRL) outputs a "beep" sound, or flickers a screen. 

(b) The control unit (WS-CTRL) displays a message that 'The CAD detects an abnormafity which does not 
exist in the finding", in a term display region in a portion cOsplaying the interpretation report created by the char- 
acter display unit (WS-CDISP). 

(c) The control unit (WS-CTRL) displays the image detecting an abnormality In the image display unit (WS- 
IDISP). 

(d) The control unit (WS-CTRL) shows the overlay data showing the detecting results of an abnormality as to 
the inrage by superimposing the overiay data on the image, (e) The control unit (WS-CTRL) displays only an 
arrow of the abnormality falling under this case out of anrows displayed as an overlay. That is, when the abnor- 
mality falls under tills case, the data that the control information of presence or absence of a display in the over- 
lay display information is still a "display" are sent to the image display manager. 

(4-3-2) The control unit (WS-CTRL) of the workstation WS-1 arouses attentions to the interpreting doctor even in 
the case where the abnormality data betonging to the above-mentioned case 2 exist. That is. the control unit (WS- 
CTRL) displays a finding number and a message for arousing attentions, describing that "Finding 4: The CAD indi- 
cates as a normality", in a term display region of a portion displaying the interpretation report created by the char- 
acter display unit (WS-CDISP). 

5. Reference of ttie CAD Processing Results by the Interpreting Doctor 

[0340] An interpreting doctor looks at the image displayed herein and tiie arrow on the overlay and refers to them. In 
order to superimpose the overlay on the image to be interpreted to be displayed, the interpreting doctor inputs a com- 
mand, an examination ID number, and an image number from the input unit (WS-INPUT). Then, if necessary, the results 
of the CAD processing, namely the abnormality data tables, can be displayed in the char-acter display unit (WS- 
CDISP). Fordoing so, the interpreting doctor is required to input a comnrand. an examination ID number, and an image 
number from the input unit (WS-INPUT). 
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(5-1 ) In the case where the interpreting doctor superimposes the image on the overlay to be displayed, correspond- 
ing opera-tions of the workstation WS-1 will be explained. 

(a) The interpreting doctor inputs a command, an examination ID number, and an Image number from the input 
unit(WS-INPUT). 

(b) The control unit (WS-CTRL) of the workstation WS-1 judges as to whether or not the indicated image is an 
applicable image of the CAD processing. The method d this judgement is compl^ely same as described in 
Section 2, Subsection (2-1-1). If tfie applicable abnormality detecting means does not exist, proceed to (c). If 
so. proceed to (d). 

(c) As the applicable abnormality detecting means has not exist-ed, the control unit (WS-CTRL) displays that 
•There are no abnor-malily detecting means which can be applied to the indicated image", in the character dis- 
play unit (WS-CDISP). Thus, the interpreting doctor can know that the indteated image was without the appfi- 
cable image of the CAD processing. After displaying, proceed to (g). 

(d) In the case where the applicable abnormality detecting means exists, the control unit (WS-CTRL) investi- 
gates as to whether or not the abnormality detected from the image exists in the abnor-malrty data table. If the 
detected abnormality exists, proceed to (e). If not. proceed to (f). 

(e) As the detected abnormality exists, the control unit (WS-CTRL) sends information necessary for superim- 
posing the Image on the overlay to be displayed, such as the overlay display informa-tion corresponding to the 
indicated image or the like, to the Image display manager (WS-IDM). The control unit (WS-CTRL) dis-plays on 
the image display unit (WS-IDISP) by superimposing the image on the overiay. The Image to be displayed 
herein was explained in Sectbn 4, Subsection (4-3-1). (d) and (e). After displaying, proceed to (g). 

(f) In the case where the abnormality has not be detected, the overlay dispaly information based on the results 
of the CAD processing corresponding to the image is not existent. In this case, there are two cases. That is, 
the case where the abnonmality Is without the applicable scope of the CAD processing at detecting the abnor- 
mality (the case 2 of Section 4. Subsection (4-2). {b-2), (ii)); and the case where the abnormality is within the 
applicable scope of the CAD processing, but has not been detected (the case 3 of Section 4. Subsection (4-2), 
(b-2), (Ii)). In the former case, the control unit (WS-CTRL) displays the indicated Image on the image dispaly 
unit (WS-IDISP) and also displays that The abnormality is without the applicable scope of the CAD processing 
and cannot be detected", in the character display unit (WS-CDISP). Furthermore, in the latter case, the confrol 
unit (WS-CTRL) displays the indicated image on the image dispaly unit (WS-IDISP) and also displays that "The 
abnormality cannot be detected from the indicated image", in the character display unit (WS-CDISP). Thus, the 
interpreting doctor can know as to whether or not the abnormality is within the applicable scope of the CAD 
processing, or that the CAD processing is applied to the indk:ated image, so that the abnomiality has not been 
detected. However, at present, this does not mean that the image Is a normal one. Because, in the conven- 
tional technique, the region capable of detecting the abnormality is limited and the type of the detectable abnor- 
mality Is limited. Therefore, the interpreting doctor is required to beforehand understand the meaning of these 
words. After displaying, proceed to (g). 

(g) This series of procedures are completed. 

(5-2) Even in the case where the interpreting doctor displays the disgnosis infomnation obtained by the CAD 
processing such as the abnormality data table, the temporal change data table of the abnomiality. or the like, oper- 
ate in the above-mentioned manner. That is: 

(a) In the case where any abnormality detecting means cannot be applied to the indicated image; 

(b) In the case where the abnormality is without the applicable scope of the CAD processing; and 

(c) In the case where the CAD processing is applied to the indicated image, so that the abnormality has not 
been detected. 

[0341] The effect is displayed on the character display unit (WS-CDISP). 
6. Conpletion of the Interpretation Report and its Storage 
(6-1) Completion of the interpretation report 

[0342] The interpreting doctor refers to the image that the image displayed in Section 5. Subsection (5-1 ). (e) is super- 
omposed on the overlay, and interprets again. As a result, the following operatrons will be carried out: 

(a) Iff the interpreting doctor recognizes to be necessary, he/!she conreds the previously inputted interpretation 
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report by inputting from the input unit (WS-INPUT). The control unit (WS-CTRL) of the workstation WS-1 changes 
the interpretation report memorized in the system memory and displays the changed data in the interpretation 
report creating region of the character display unit (WS-CDISP). 

(b) After completing the correction, the interpreting doctor inputs an interpretation completing command from the 
5 input unit (WS-INPUT). 

(c) Next, the control unit (WS-CTRL) displays to urge to input the interpreting doctor ID number into the character 
display unit (WS-CDISP), and the interpreting doctor Inputs the interpreting doctor ID number allotted to him- 
seff/herself. The control unit (WS-CTRL) investigates as to whether or not the inputted interpreting doctor ID 
number exists in the interpreting doctor information table (refer to Fig. 42). H so. the control unit (WS-CTRL) selects 

TO the name of an interpreting doctor corresponding to the interpreting doctor ID number as a name of an interpreting 
doctor which is attached to the interpretation report. 

(d) The control unit (WS-CTRL) attaches data concerning from the patient ID number to the date of interpretation 
out of the data included in the interpretation report as shown in Fig. 54 to the finding of the created interpretation 
report and the conclusion. The examination histories of a patient contain the data other than the name of the inter- 
ns pretation doctor and the date of the interpretation out of these data. The name of the interpreting doctor which has 

been decided in the above (c) is used. The date of the interpretation can be decided by a dock which is integral 
with the workstation WS-1 . 

(6-2) Transfer of the interpretation report and storage 

20 

[0343] 

(a) The control unit (WS-CTRL) of the workstation WS-1 sends the completed interpretation report to the network 
interface (WS-NWIF) and indicates to transfer the interpretation report to the system manager (SM) 1 . The network 

2S interface (WS-NWIF) sends the interpretation report to the system manager (SM) 1 . 

(b) When the interpretation report is sent from the workstation WS-1 to the network interface of the system man- 
ager (SM) 1 . the system manager (SM) 1 reads out the interpretation report from the network interface, and writes 
it into the system memory in its own control unit. Furthermore, the Interpretation report is transferred from this sys- 
tem memory to the interpretation report data unit to be memorized. 

30 

[0344] At this time, a series of operations (Sections 1 to 6) of the CAD processing after the image has been sent to 
the above-mentioned workstation (WS) 4; and from the production of the diagnosis information to the completion of the 
interpretation report: and the staage has been finished. 

[0345] In this connection, in this embodiment, the desaiption as to the medical image was made, however this 
35 embodiment may also be applied to the medical examination data other than the image, that is the data of a graphic 
such as an electrocardiogram, brain waves, or the like, or the data ananging a numerical value obtained by an auto- 
matic chemical analyzer etc. 

[0346] Also, in this embodiment, an example of the chest X-ray image was explained, however this embodiment can 
be applied to the medical examination data of the image etc. of an organ of a digestive organ system such as a stomach 
40 etc. other than a chest. 

[0347] As described above, in the present Invention, the processing results of the CAD processing and the findings 
of the inputted interpretation report are compared in detail as to the scope to be processed, the position of diseases, or 
the like, whereby the interpretation report can automatically be checked. Furthermore, the results of the comparison are 
outputted to be informed the interpretation doctor thereof, whereby the diagnosis of the interpreting doctor can be sup- 
45 ported to enhance accuracy in the diagnosis. Furthermore, when the results of the CAD processing are different from 
the finding of the inputted interpretation report in the results of the comparison, as the results of the comparison are 
outputted only as to its diagnosis items, efficiency in the interpretation is enhanced. 

[0348] If the indicated image is within the applicable scope of the CAD processing, the CAD processing can automat- 
ically be carried out by the interpreting doctor's indication. Also, even if the interpreting doctor demands to display the 

so results of ttie CAD processing, when the abnomiality was not pointed out. he/fehe can know separately as to whether 
or not the abnormality detecting means of the CAD processing which can be applied to the image does not exist, or 
whether or not the indicated image is without the applicable scope of the CAD processing, or whether or not the abnor- 
mality has not been detected even if the CAD processing is canted out Therefore, this embodlmant is effective in that 
efficiency of the interpretation enhances or the like. 

55 [0349] (To be continued) 
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Embodiment No. 5 and Embodiment Kto. 6 

[0350] Hereinafter, the present invention according to fifth and sixth preferred embodiments will be explained with ref- 
erence to the accompanying drawings FIGS. 62 - FIGS. 107. In these embodiments, an embodiment of performing a 
CAD by using a PACS will be described, and first of all. the gist of the present invention according to fifth and sixth 
embodiments will be described, and next a system configuration of the PACS will be described, and finally procedures 
in the case of interpreting by using the system of the present invention according to fifth and sixth embodiments will be 
described in detail. After the descriptions on the system configuration of the PACS and there will be taken up an exam- 
ple where medically interpreted is a chest X-ray image for a lung cancer examination. 

[0351 ] Figs. 62A & 62B and 63A & 63B are flowcharts for explaining the gist of these embodiments. Figs. 62A and 
62B show the invention according to fifth embodiment and Figs. 63A and 638 show the gist of the invention according 
to sixth embodiment. 

[0352] Fig. 62A shows the gist having the broadest sense in fifth embodiment, and a plurality of medical examination 
data (image data etc.) obtained by a medical group examination or the like are inputted into a cbatabase DB of a medical 
information processing system. Then, the CAD processing as to each of the inputted medical examination data is car- 
ried out to detect an abnormality. This CAD processing can be canied out in any methods, however the method Is 
required to include a processing in which the probability of a normality is high or a processing in which the probability 
of an abnormality is high. "men. the results of the CAD processing are classified into a plural group to input the medical 
examination data or identification information of the medical examination data according to the classification results. In 
this figure, an example of classifying into three groips A, B. and C is shown, however this embodiment is not limited to 
this. For example, the classification into two groups can be made: this case where only data having the high prcbability 
of a normality are beforehand extracted and the remainder is interpreted by a doctor etc.; and that case where only data 
having the high probability of an abnormality are beforehand extracted and the remainder is Interpreted by a doctor etc. 
As shown in the figure, in the case of classifying into three groups A, B. and C. the classification A Is for a normality with 
the high probability to output the diagnostic results as a "normality'', and the classification B is for an abnormality with 
the high probability to output the diagnostic results as an "abnormality", and the classification C demands a doctor's 
interpretation to output the medical examination data together with associated information. Thus, by using the CAD, the 
report can be made in the early stage to the patient (examined person) belonging to the classification B having the high 
probability of an abnormality, and also as It is possible to reduce the number of sheets of a doctor's interpretation, It con- 
tributes to save a doctors labor. 

[0353] Rg. 62B shows specifically this embodiment. Information concerning an oral examination or disease histories 
is inputted from a hearing information input unit HI and image data of a certain type of medical examination data are 
irputted from an image acquisition unit lA. In the database DB into which these are inputted, each image data Is CAD- 
processed to detect an abnormality to classify the results into the three groups A. B, and C as described in Fig. 62A. 
Then, as to the classifications A and B, the diagnostic results are outputted, and as to the classification C, image data 
as a doctor's interpretation, oral examination patient history information relating to the image data, and the like are out- 
putted. As a result, the image data, the oral examination information, etc. belonging to the classification C are sent from 
the database DB to the workstation WS to display the image data thereon, and a doctor interprets the image data. The 
interpreting doctor creates and inputs a finding data table which is interpretation results as to each image data. When 
the doctor finishes interpreting, the results are sent from ttie workstation WS to the database DB to register therein. The 
interpretation in the medical group examination is made by two or more doctors and at least two finding data are sent 
to the database DB. Then, the database DB compares and classifies the registered finding data and selects the classi- 
fying results and creates so as to report to each examined person to send the report to a conpany to which the exam- 
ined person belongs or a self-government community etc. 

[0354] Figs. 63A and 63B show the gist of another embodiment and Fig. 63A shows the gist in a broad sense. Then, 
as seen by comparing with Rg. 62A, the CAD processing is can-led out as to each of the inputted medical examination 
data to detect the abnormality, and the results are classified into a plural group to output the medical examination data 
or the identification information of the medical examination data according to the classification results. These proce- 
dures are entirely identical to Rg. 62A so far. In Rg. 63A, as to the data demanding the doctor's interpretation belonging 
to the classification C. the CAD processing is carried out once more by the other references such as a diagnostic level 
equal to the doctor etc. to obtain second diagnostic information so that it can be contributory to the doctor's diagnosis. 
The second results of the CAD processing are outputted by an abnormality detailed data table. Also, the CAD process- 
ing is carried out once more according to the other references, and this procedure is applied to not only the case of clas- 
sifying into three groups, but also the case of classifying into two groups as described above concerning Fig. 62A. That 
is, in the case where only the data having the high probability of a normality and the high probability of an abnormality 
are beforehand extracted and the remainder is interpreted the doctor etc., the CAD processing is canried out once 
more for the remaining medical examination data 

[0355] Rg. 63B shows specifically the gist of still another embodiment. In the same manner as Fig. 63A. the CAD 
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processing is carried out as to the image data to detect an abnonnaiity, and the results are classified Into a plural group 
to output them according to the classification results. These procedures are entirely identical to Fig. 62B so far. In Fig. 
63B. as to the data demanding the doctor's interpretation belonging to the classification C. the CAD processing is car- 
ried out once more by the other references such as a diagnostic level equal to the doctor etc. to output (containing dis- 
playing) the results by an abnonnaiity detailed data table or the like. On the other hand, the image data, the oral 
examination information, and the like belonging to the classification C are sent from the database DB to the workstation 
WS to display the image data therein, and the doctor interprets. The interpreting doctor creates a finding data table 
which is the interpretation results as to each Image data to be inputted. When the doctor finishes interpreting a series 
of data, the finding data table and the abnormality detailed data table of the CAD processing results are compared and 
classified to create an abnonnaiity detecting result list of the results to output it each classification. Accordingly, the doc- 
tor outputs the abnornrallty detecting result list at re-interpreting the data and refers to associated information and inter- 
prets tha data to complete the finding data table, and the results are sent from the workstation WS to the database DB 
to be registered therein. The interpretation in the medical group examination is earned out by two or more doctors, and 
at least the two completed finding data tables are sent to the database DB. The later processing is entirely identical to 
Fig.62B. 

[0356] In this connection, the broken line part In the figure indicates not to be a crucial part in the present invention. 
Also, the CAD processing has been explained in an exanple which is carried out in tiie database DB, however the 
image data etc. can be sent to the workstation WS to be carried out therein. 

[0357] Next, an example of a basic system configuration of the PACS is shown in Fig, 15. TTiis system comprises 
respective units (subsystems) as fbllows:l) Hearing information input unit (Hl);2) Image acquisition unit (IA);3) Data- 
base (DB);4) Workstation (WS). 

[0358] The hearing information input unit (H I) is a device for inputting hearing information or disease hitories which is 
obtained by an oral examination to examined persons. 

[0359] The image acquisition unit (lA) is a medical image aoqusition unit for the PACS such as an X-ray machine, an 
X-ray CT machine, an MRI machine, a film digitizer or the like. Herein, it is defined as an X-ray machine which is placed 
on a medical examination car. 

[0360] The database (DB) Is used for storing various data to be produced in operations of the medical examination. 
[0361] The workstation (WS) appropriately processes digital Images etc. sent from the database (DB) or the image 
acquisition unit (lA) to obtain desired results to display or output them. In these embodiments, the workstatton is used 
for interpreting radiographed images. 

[0362] Communications among tiiese four types of units are earned out by using a data memory nfiedium capable of 
canrying and rewriting, such as an optical magnetic disk or the like. 

[0363] Next functions of each unit (subsystem) and its configuratlonal element will be described. 
[0364] Main functions and operations of the hearing information input unit (HI) will be described. 

To display a hearing sheet (questioning contents for a person to be examined). Items described on the hearing 
sheet are shown in Fig. 16. 

* To input identification information of a person to be examined (person ID number) 

To input and display responses of an examined person to the items described in the questioning sheet. 

To write inputted responses (hearing information) and the identification intormatioh of an examined person into the 

optical magnetic disk. 

[0365] The hearing Information Input unit (HO can readily be realized by adapting a personal computer to be obtained 
in tiie market. As the configuration has no connection with the gist of tiie present invention, the description is omitted. 
[0366] As the image acquisition unit (lA), first main functions are descrbed. 

To acquire digital image data.o To input tiie klentification Information of a person to be examined (patient ID 
number). 

* To input and display information attached to an examination and an image. 

To write the identification information of an examined person, image data, and information attached to an examina- 
tion and an image into the optical magnetic disk. 

[0367] As for ttie image acquisition (lA), a configuration element and its functions will be described. The configuration 
of the image acquisition unit (lA) is shown in Fig. 17. 

Control UnH (lA-CTRL) 

[0368] A control unit contains a central processing unit (CPU) or system memories (namely, semiconductor memory) 
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etc. and controls operations of the entire tntage acquisition unit. 
System Disk (lA-SD) 

5 [0369] This is a magnetic disk and stores a program or data, such as: (a) a program for operating an Image acquisition 
unit; (b) identification information of a person to be examined: and (c) information attached to an examination and an 
image. This program is read out when the image acquisition unit is turned on and written into system memories wvittiin 
the control unit (lA-CTRL). Furthennore. the idetification information of an examined person and ttte information 
attached to an examination and an image are stored each examination and a type of the data is shown in Rg. 18 

70 together with a data configuration. 

X-ray Generator (lA-XQEN) 

[0370] This is a devkse for generating X-rays to inadiate a person to be exposed. 

IS 

X-ray Imaging UnH(IA-IMG} 

[0371 ] This is a device for detecting X-rays transmitted through a person to be exposed, converting them into electric 
signals, and digitizing the signals to obtain a digital image. This contains an image intensifier. a TV camera, an ana- 
20 log/digital converter and tiie like. 

Input Unit (lA-INPUT) 

[0372] This is means for inputting information such as commands etc. by an operator and uses a keyboard, a mouse. 

25 a touch screen or the like. 

Display Unit (lA-DlSP) 

[0373] This is a device for displaying information inputted by an operator and digital image acquired, and uses a CRT 
30 display, a liquid crystal panel display or the like. 

Image Data Unit (lA-lM) 

[0374] This is a device for temporarily storing digital Image data acquired by tfie X-ray Imaging unit (for example, a 
35 semiconductor memory or a magnetic disk). 

Optical Disk Drive (lA-MODD) 

[0375] This is a device for reading data out of a portable optical magnette disk or writing data thereinto. 

40 

Control Bus (lA-CBUS) 

[0376] This is a transmission patii of various control information wittiln ttie image acquisition unit. 
45 Image Bus (lA-IBUS) 

[0377] This is a transmission patii of image data within the image acquisition unit 
[0378] Also, a dock (not shown in Fig. 18) is integral witti tiie image acquisition unit. 
[0379] As for tiie database (DB), first main functions and operations will be explained. 

so 

The database (DB) stores identification information of an examined person, hearing Information, image data, and 
informationattached to examination information and an image. 
* The database (DB) stores findings which are doctors* interpretation results. 

The database (DB) detects images having doubtful abnormalities from image data. 
55 * The database (DB) can wrHe various data Into tiie portable optical magnetic disk or read them out of it. 

[0380] Configuration elements and functions in ttie database (DB) will be deswibed. The configuration of the data- 
base (DB) is shown in Fig. 19. 
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Control Unit(DB-CTRL) 

[0381 1 This indudes a central processing unit (CPU), systen) memories (namely, semiconducting memory) or the like 
and controls operations of the entire database. 

5 

System Disk (DB-8D) 

[0382] This is a magnetic disk and stores a program for operating the datatase or the like. This program etc. is read 
out when an electric power of the database is tumed on and written Into system memories within the control unit (DB- 
w CTRL). 

Search Unit (DB-SRCH) 

[0383] This searches information confomiing to a given keyword according to an instruction from the control unit (DB- 
15 CTRL), and is a device having functions of replying searched results to the control unit (DB-CTRL). The search unit 
includes a directory of information stored in the database and searching means. A magnetic disk is used as storing 
means of tiie directory. 

Data Storing Unit (DB-STRG) 

20 

[0384] This is a device for storing identification information of an examined person, hearing information. Image data, 
information attached to examination information and an image, and doctor's findings for a long-termed period, and an 
optical disk is used as the data storing unit (BD-STRG). 

[0385] Herein, identification information of medical examination data in association witii the identification information 

25 of the examined person will be explained. The data of the examined person, the medical inspection, and the examina- 
tion (Image) data are the relationship like a tree-type chart as shown in Fig. 64. TTiis is because there are some possi- 
bilities that one examined person is made a plurality of medical examinations and that a plurality of examination (image) 
data produce each medical examination. kJentif feation information of the medical examinatfon data is one correspond- 
ing to the examinatfon (image) data individually and capable of specifying the medical examination (image) data from 

30 the dentiflcation informatfon. For instance, in the case where the examination data Is the image data, the identification 
information is an image ID mrvber etc. from which an examination ID number, an examined patient ID nunt)er, a name 
of an examined patient, and the like can be searched. In Rg. 64, the identificatfon information is equal to 1 Act to nXca 
and for instance, if the image ID number is 208. 2Q6 means the examined patient ID number 2, the examination ID 
number 2G. and the G-th examination of the examined patient ID number 2, and 6 means ttie 6-th image of the G-th 

35 examination. Alternatively, as shown In Figs. 65A & 65B and 66A & 66B. a con-esponding table of the examined patient 
ID number, the examination ID number, and the examination (image) data ID number exists in this data storing unit (DB- 
STRG) to search each other. Figs. 65A and 65B show the case where the examination (image) data ID number is 
searched from the examined patient ID number, and as shown in Fig. 65A, the examination ID number is recognized 
from the examined patient ID number, whereby the examination (image) data ID number can be extracted from tfiis 

40 examination ID number as shown in Fig. 65B. Reversely. Rgs 66A and 66B shows the case where the examined 
patient ID number is searched from tiie examination (Image) data ID number. 

[0386] In this embodiment, a medical examination Is made once per examined patient in order to avoid complexity 
and a sheet of example is picked up in ttie image produced in ttie examination. Accordingly, the identification informa- 
tion of the medical examination data, the examination identif cation information, and ttie examined patient identification 
45 information are in the same definition. However, as described above, in the case where one examined patient receives 
a plurality of medical examinations, or a plurality of examination (image) data produces in one medical examination, the 
identificatfon information of the medical examination data is required to combine the examined patient ID number, ttie 
examination ID number, and the examinatfon (image) data ID number, or search each other. 

so image Processing Unit (DB-IP) 

[0387] This is means for detecting abnormalities from an image, and when Image data and data indicating a type of 
abnormalities (disease) which is an object to be detected are inputted, the image processing unit (DB-IP) detects the 
type of abnormalities and outputs a positton and a degree of abnormalities, and includes a plurality of types of abnor- 
55 mality detecting means. That is: 

(a) means for detecting shadows of pulmonary nodules in a front side image in a chest plain X-ray image; and 

(b) means for detecting shadows of pulmonary interstitial disease in a front side image in a chest X-ray 
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image.These detecting means are disclosed in the below-mentioned litefatures:(1) Japanese Patent Application 
Laid-open Na 2-185240 (2) Japanese Patent Application Laid-Open No. 2-152443 (3) Japanese Patent Applica- 
tion Uid-Open No. 1-125675. 

5 Input Unit (DB-INPUT) 

[0388] This is means for inputting infamation such as commands by an operator, and a keyboard, a touch screen, or 
the tike is used Ibr the input unit (DB-INPUT). 

10 Optical Magnetic Disk Drive (DB-MODD) 

[0389] This is a devtee which reads data out of the potable optical magnetic disk or writes them into it. 

Control Bus (DB-CBUS) 

IS 

[0390] This is a transmission path of various control information within the database 

Inrage Bus(OB-IBUS) 

20 [0391 ] This is a transmission path of image data within the database. 

[0392] First, main functions and operations of the workstation (WS) win be described. 

* To display identif k;ation information of an examined person, hearing information, image data, infonnation attached 
to examination information and an image, and doctor's findings. 

25 * To display various infonnation concerning abnormalities such as a type of abnormalities (disease), a position and 
degree of abnormalities, or the like. 

* To input the findings which are doctor's interpreting results. 

' To write various data into the portable optical magnetic disk or read them out of it. 

30 [0393] Next, configuration elements and functions of ttie workstation (WS) will be described. Fig. 20 is a configura- 
tional diagram of the workstation (WS). 

Control Unit (WS-GTRL) 

35 [0394] This contains a central processing unit (CPU), system memories (namely, semiconductor memory), and the 
like and controls operations of the entire workstation. 

System Disk (ES-SD) 

40 [0395] This is a magnetic disk and stores a program etc. This program is read out when an electric power of the work- 
statfon (WS) is switched on. and written into the system memories within the control unit (WS-CTRL). 

input Unit (WS-INPUT) 

45 [0396] This is means tor inputting infonnation such as commands, interpretation reports (findings), or the like by an 
operator, and a keyboard, a mouse, a touch screen, or the like is used for the input unit (WS-INPUT). The touch screen 
is mounted onto a screen of the display unit (WS-DISP). 

Data Memory (WS-MEM) 

so 

[0397] This is a device for temporarily storing various data such as image data etc. and is a magnetic disk, 
imaging Frame Memory (WS-IFM) 
55 [0398] This is a device for temporarily storing a plural sheet of image data and a semnonductor memory. 
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Image Display Manager (WS-IDM) 

[0399] This operates so as to display an Image and an overlay. Fig. 21 Is a configurational diagram of the image dis- 
play manager (WS IDM) and a part ol the image display manager (WS-IDM) is shown within a broken line This includes 
the following portions: 

a) Control Portion 

TTiis controls the entire configuration portion of the image display manager (WS-IDIi/l). 

b) Overlay Data Making Portion 

TTiis makes overlay data (color) from overlay display information. This contains means for displaying by flicker- 
ing as to data indicated in the overlay display information. 

c) Image Memory for Storing Image Data 

This has memories oon'esponding to a sheet of image (a matrix size is 2,048 x 2.048 pixels). 

d) Overlay Memory for Storing Overlay Data 

Since the overiay data are displayed in color, the overlay memories corresponding to one screen are con- 
structed of three sheets of overlay memory for red, green, and blue. In the over-lay memory for each color, a matrix 
size is conceptually 2,048 x 2,048 pixels, and a bit length of 1 pixel is 1 bit. The relationship between a display color 
and a bit value of each pixel is shown in Rg. 22. In Fig. 22, for example as shown in Step 2. a pixel value (a bit value 
of pixel) of a pixel coordinate (X, Y) of the overlay memory for red Is 1 . and a pixel value of the same coordinate of 
the overlay memory for both green and blue is 0. and a red color is displayed as to the coordinate. On the other 
hand, black in a display color means that any colors are not displayed, and when black Is doubly displayed on an 
image, only the image is displayed. 

e) Overlay Portion 

An overlay portion superimposes image data on overlay data. 

f) Displaying Memory for Storing Display Data 

This image display manager (WS-IDM) has two sheets of memory for displaying a sheet of image (a matrix size 
is 2,048 X 2,048 pixels). This is equal to the number of the display units (WS-DISP). The memories for displaying 
correspond to the display units (WS-DISP), respectively. 

g) D/A Converter 

This converts display data of digital data into those of analog data. 

This is provided with the same number as the display unit (WS-DISP) so as to conrespond to It. 

[0400] The image display manager (WS-IDM) can receive the following information: 

(a) Type of data to be displayed 

Three types: an image only, an overiay only, an image and an overlay combined. 

(b) Designated information of the display unit (WS-DiSP) displaying data 

(c) Overlay display information 

A type of a graphic, a size of a graphic, coordinates, a display color, presence or absence of display (containing 
a flicker), control information, or the like per graphic, 
(cl) Image Data 

When displaying an image overlapping an overlay, the image display manager (WS-IDM) operates in the fol- 
lowing manner: 

(1 ) The control portion of the image display manager (WS-IDM) receives the betow-mentloned three informa- 
tion from the control unit (WS-CTRL) of the workstation (WS). 

(a) "Images and overiays" as a type of data to be displayed. 

(b) A display unit number of the display unit (WS-DISP] displaying data. 

(c) Overlay Display Infbnmation 

(2) The Image display manager (WS-IDM) receives image data and writes them into the Image memories. 

(3) The overlay data making portion makes overlay data based on overiay display Information by an instruction 
of the control portion. Then, when control information of presence or absence of display is a "display", the over- 
lay data making portion makes the overlay data with an indicated graphic, indicated coordinates, and indicated 
color data. 

(4) The image data and overiay data are read out by an instructk>n of the control portion to input them into the 
overiay portion to synthesize the data. 
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(5) The synthesized data are written Into dispatying meniorles with an indicated display unit nunnber. 

(6) The synthesized data are converted into analog data by the D/A converter. 

[0401 J The above-mentioned operations (4) to (6) are always repeated during the display. 
5 [0402] Only when the control information of presence or absence of display (containing a f Gcker) denotes a "display" 
as to a graphic in cetain coordinates, the overlay data making portion writes the graphic into the overlay memories to 

display it. 

[0403] On the other hand, when an image is just displayed, in the above-mentioned operation (1). the overlay data 
making portion receives: 

10 

(a) an "only image" as a type of data to be displayed; and 

(b) a display unit number of the display unit displaying data, however the portion does not receive the overlay dis- 
play information. Then, in the above-mentioned operation (4), the overlay data making portion does not read out 
the overlay data, and aocordingly does not superinpose the image data on the overlay data. 

IS 

Display Unit (WS-DISP) 

[0404] This is a device for displaying characters, graphics, and images, and a CRT display, a liquid crystal panel dis- 
play, or the like is used for the display unit. A color display is availabia In this embodiment, two units are set. 

20 

Optical niiagnetlc Disk Drive (WS^MODD) 

[0405] This Is a device for reading or writing data for a portable optical magnetic disic 
25 Control Bus (WS CBUS) 

[0406] This is a transmission path of various control information within the workstation. 
Image Bus (WS-IBUS) 

30 

[0407] This is a transmission path of image data and overlay data within the workstation. 
[0408] In this connection, a dock for referring to a date and a time (not shown in the figure) is integral with the work- 
station (WS). 

[0409] Thus-constructed PACS Is used, and a flow of a series of system operations Is described, for example, when 
35 a chest X-ray image in a lung cancer examination is interpreted. 

[0410] The operations will be canied out in the foltowing procedures: 

1. Input of hearing information 

2. Acquisition of chest X-ray image 
40 3. Registration of acquired data 

4. Preparation of interpreting data 

5. interpretation of image data 

6. Output of interpreting results 

45 [0411] Hereinafter, In the the following variations of fifth emboidmnt (emboidmet 5-1. 5-2. 5-3, the above-mentioned 
series of system operations will be described In detail. 

EmtxKfimentNaS-l 

so 1 . Input of Hearing Examination 

(1 ) Display of hearing sheet 

[041 2] A hearing sheet is displayed on a display saeen of the hearing information Input unit (HI). 
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(2) Input of hearing information 
[0413] 

(i) An oprator inputs examined person identification information from tlie hearing information input unit (HI). The 
examined person identification information is assigned to tiie examined person so as not to overlap each otiier 
within such medical examination area, and an examined patient ID number descn*bed in a register shall here be 
inputted. The inputted data are displayed in a ^ctf ic position on a screen. 

(ii) An operator inputs a response obtained from the examined person in the hearing infbrmation Input unit (HI). The 
inputted data are displayed in a specific position on a screen. 

[0414] The above-mentioned Subsections (1) and (2) are repeated only by a number of examined persons. 

(3) Write hearing infbrmation into optical magnetic disk 

[041 5] The control unit of the hearing information input unit (HI) reads out hearing infbrmation (examined person Iden- 
tification infbrmation and responses from the examined persons) stored in the system disk by an instruction of an oper- 
ator, and writes it into the optical magnetic disk inserted into the optical magnetic disk drive (HI-MODD). 
[041 6] The thus-obtained optical magn^ic disk is later canied to a certain position of the database (DB). 

2. Acquisition of Chest X-ray Images 

(1) input of examined person klentification infbrmation 

[0417] An operator inputs examined person identification information from the input unit (lA-INPUT) of the image 
acquisition unit (lA). The inputted data are displayed in a specific position on a screen of the display unit (lA-DISP). 

(2) Acquisition of digital image 
[0418] 

(i) The control unit (lA-CTRL) indicates to irradiate X-rays and image to the X-ray generator (lA-XGEN) and the X- 
ray imaging unit (lA-lMQ). The X-ray generator (lA-XQEN) generates X-rays and irradiates ttiem onto a person to 
be exposed (person to be examined). The X-rays transmitted through the person to be exposed are detected by the 
X-ray imaging unit (lA-IMG) to obtain digital images. The X-ray imaging unit (lA-IMG) transmits image data to the 
image bus (lA-IBUS). As a result, the image data unit (lA-IM) receives the image data to write them to itself. 

(ii) The control unit (lA-CTRL) writes information attached to imaging conditions or images together with examined 
person identification infbrmation into the system disk (lA-SD). 

[041 9] The above-mentioned Subsections (1 ) and (2) are repeated by a number of jaersons to be examined. 

(3) Write into optical magnetic disk of data 
[0420] 

(0 The control unit (lA-CTRL) reads out infbrmation attached to an examination and an image whidi is stored in the 
system disk (lA-SD) by an instruction of an operator, and writes it into an optical magnetic disk inserted into the 
optical magnetic disk drive (lA-MODD). 

(ii) The control unit (lA-CTRL) successively reads out image data from the image data unit (lA-IM) and writes them 
into the optical magnetic disk inseted into the optical magnetic disk drive (lA-MODD). 

[0421] The thus-obtained optical magnetic disk Is later carried to a cetain position of the database (DB). 

3. Regisb^ation of Acquired Data 
[0422] 

(i) An operator inserts the optical magnetic disk registering hearing inlbmiation into the optical magnetic disk drive 
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(DB-MODD) of the database (DB), and inputs a hearing information readout command of the optical magnetic cGsk 
from the input unit (DB-INPUTl. Then, by an instruction of the control unit (DB-CTRL), the optical magnetic cfisk 
drive (DB-MODD) reads out the hearing information registered in the optical magnetic disk and writes it into the 
data storing unit (DB-STRG). The control unit (DB-CTRL) extracts information (hereinafter, referred to as directory 
information. Refer to Fig. 20) registered in a data directory from the hearing information to send it to the search unit 
(DB-SRCH). The search unit (DB-SRCH) stores the received directory information. 

Furthermore, the control unit (DB-CTRL) extracts the previously radiographed image data (in the past) of 
examined persons (hereinafter, called previous or past image data) from the examined person identification infor- 
mation of the hearing information from the data storing unit (DB-STRG) to send them to the search unit (DB- 
SRCH). The search unit (DB-SRCH) adds the received previous image data to the directory information, 
(ii) An operator inserts the optical magnetic disk registering information attached to an examinatfon and an image 
and the Image data into the optical magnetic disk drive (DB-MODD) of the database (DB). and inputs an image 
information readout command of the optical magnetic disk from the input unit (DB-INPUT). Then, by an Instruction 
of the control unit (DB-CTRL), the optical magnetic disk drive (DB-MODD) reads out the Information attached to an 
examination and an image and the image data which are registered in the optical magnetic disk and writes it into 
the data storing unit (DB-STRG). The control unit (DB-CTRL) extracts directory informatfon from the information 
attached to an examination and an image to send it to the search unit (DB-SRCH). The search unit (DB-SRCH) 
stores the received directory infonnation 

4. Preparation of Interpreting Data 

(1) Detection of an abnormality from an image using a plurality of threshold values 
[0423] 

(i) When finishing registering the data, the control unit (DB-CTRL) of the database (DB) Indicates the search unit 
(DB-SRCH) to search the registered images (Images to be Interpreted and previous images) to obtain a response. 
Successively, the control unit (DB-CTRL) indicates to perform the following abnormality detecting operations for 
each sheet of images. The abnormality to be detected is shadows of pulmonary nodules or an interstitial lung dis- 
ease. Herein, a IhreshoW value will be explained. According to statistics, normal persons and abnonnal persons 
distribute as shown In Fig. 67. In Fig. 67. the value of Xc is found and it is judged that a blank portion left-sided from 
this value is "normal", and that an oblique line portion (hatched area) right-sided from this value is "abnormal", in 
order to output them. Such judgement reference value Xc of the normality or abnormality is a threshold value. 
When this threshold value Xc is moved extremely leflwardly as shown in Fig. 68, the scope of the normality 
becomes nan^ow, and as the output results, the "normality" is lessened and the "abnormality'' is Increased. 
Reversely, as shown in Rg. 69, when the threshold value Xc is moved extremely rightwardly, the scope of the 
abnormality becomes narrow, and as the output results, the "normality" Is increased and the "abnormality" is less- 
ened. In the abnormality detecting means as to the above-mentioned two types of an abnormality, the detection of 
the abnormality can be realized by changing varfous parameters and threshold levels. In this embodiment, two 
threshold values can be respectively applied to each of the abnormality detecting means, and the scope of the nor- 
mality is set so as to be narrow in the first threshold value and the scope of the abnormality Is set so as to be narrow 
In the second threshold value. The data existent In each scope have the high probability of the normality and abnor- 
mality. 

(ii) Image data corresponding to a sheet of image are read out from the data storing unit (DB-STRG) and sent to 
the image processing unit (DB-IP). The image processing unit (DB-IP) receives the image data and operates pul- 
monary nodules shadow detecting means by using the first threshold value stored inside to detect presence or 
absence of the abnormalities. The detected results are written into an abnormality data table as first detected 
results of pulmonary nodules. The image of the examination ID number 920001 is written as the "abnormality". 
Next, the image processing unit (DB-IP) operates the pulmonary nodules shadow detecting means by using the 
second threshold value to detect presence or absence of the abnormality The detected results by the pulmonary 
nodules shadow detecting means by using the second threshold value are written Into the abnormality data table 
as the second delected results of the pulmonary nodules. The Image of the examinatfon ID number 920001 Is writ- 
ten as the "abnormality". 

(lii) The Image processing unit (DB-IP) operates, in the same manner as the pulmonary nodules, the interstitial lung 
disease detecting means by using the first threshold value stored inside and the interstitial lung disease detecting 
means by using the second threshold value to detect presence or absence of the abnomiality. The detected results 
are written into the abnormality data table as the first and second detected results. The Image of the examination 
ID number 920001 is written as the "abnormality" at using the interstitial lung disease detecting means by using the 
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first threshold value, and as the "normality' at using the interstitial lung disease detecting means by using the sec- 
ond threshold value. 

[0424] The abnormality data table concerning the Image of the examination ID number 920001 is shown In Fig. 70. 
5 [0425] The abnonnality data tables in the images of the examination ID numbers 920002 to 920010 are shown in Figs. 
70 to 79. Nodule in the figures denotes pulmonary nodules and ILD denotes an interstitial lung disease. 

(2) Classilication of data according to the detected abnormalities 
w [0426] 

(i) The control unit (DB-CTRL) compares respective abnormality detected results of the abnormality data table 
each type of the abnormality. The types of the detected abnormalities are the pulmonary nodules and interstitial 
lung disease. The results detected by using two threshold values lor each type of the abnormality are classified as 

IS follows: This Is called a first classification. 

Case 1 : The case where both of the first detected results and the second detected results are "normal". 
Case 2: The case where one detected results are "abnormal" and the other detected results are "normal". 
Case 3: The case where both of the first detected results and the second detected results are "abnormal". 

20 

Next, the above-mentioned classification results are compared each type of the abnormality to classify as fol- 
lows: This is called a second classification. 

25 Case A: The classified results of the type of all abnormalities have been classified in the case 1 . 

Case B: There exist even one of the types of the abnormality classified In the case 3. 
Case C: This case does not fall under both of the case A and the case B. 

The data falling under the cases A. B. and C are listed to register into lists A. B. and C. 

30 (ii) As an embodiment of the classification, the classification of the image of the examination ID number 920001 will 
be described. The results of the pulmonary nodules In the abnormality data table as shown In Fig. 70 fall under the 
case 3 in the first classification since both of the first detected results and the second detected results are "abnor- 
mal". Also, the results of the interstltisi lung disease in the abnormality data tatHe as shown In Fig. 70 fall under the 
case 2 in the first classification since the first detected results are "abnormal" and the second detected results are 

35 "normal". Accordingly, the data fall under the case 8 in the second classification. 

(iil) The classified results of the images of the examination ID numbers 920001 to 920010 are shown in Fig. 80. 
Also, the examination ID numbers in which the second classified results fall under the case A, the case B. and the 
case C are respectively registered in the list A. the list B, and the list C. The created list A, list B, and list C are 
shown in Rgs. 81 , 82. and 83. 

40 

(3) Preparation of interpreting data 
[0427] 

45 (i) When the abnormality detecting processing from the images is finished, the control unit (DB-CTRL) indicates the 
data storing unit (DB-STRG) to read out the image data to be interpreted, the previous image data, the hearing 
information, and the information attached to an examination and an image (containing the abnormality data table) 
of the examination ID number registered in the list C. and Indicates the optical magnetic disk drive (DB-MODD) to 
write them. The data storing unit (DB-STRG) reads out these data to send to the image bus (DB-IBUS). The optical 

so magnetic drive (DB-MODD) receives these data and writes into ttie optical magnetic disk C. 

(ii) The control unit (DB-CTRL) associates the examined patient idetif ication information, the name of the examined 
patient, and the abnormality data table corresponding to the examination ID number registered In the list B with 
each other, and Indicates tiie optical magnetic disk drive (DB-MODD) to wtite the overall judgement results as an 
"abnormality". Then, the data storing unit (DB-STRG) reads out tfiese data to send to the image bus (DB-IBUS). 

55 The optical magnetic disk drive (DB-MODD) receives these data to write Into tiie optical magnetic disk B. 

(iii) The control unit (DB-CTRL) associates ttie examined patient identification information and the name of ttie 
examined patient corresponding to the examination ID number registered in the list A witii each other and indicates 
the optical magnetic disk drive PB-MODD) to write the overall judgement results as a "normality". Then, the data 
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storing unit (DB-STRG) reads out these date to send to the image bus (DB-IBUS). The optical magnetic disk drive 
(DB-MODO) receives these data to write into the optical magnetic disk B. 

[0428] The optical magnetic disk B is canied to the patient to be reported to make such a report recommending the 
patient who is reported the overall judgement results "abnormalit/' to make a dose examination. 
[0429] In the medical group exanvnation, the interpretation is carried out by two doctors. Accordingly, two optical mag- 
netic disks C are prepared to canry each sheet to each of two workstations (WS). 

5. Interpretation of Image Data 

(1) Input of interpreting data into workstation (WS) 

[0430] An operator inserts the optical magnetic cOsk C registering image data to be interpreted, previous image data, 
hearing information, and information attached to an examination and an image into the optical magnetic disk drive (DB- 
MODD) of the workstation (WS) and inputs a data readout command from the optical magnette disk C from the Input 
unit (WS-INPU"0. Then, by an Instruction of the control unit (WS-CTRL). the optical magnetic disk drive (DB-MODD) 
reads out the data stored in the optical magnetic disk C and writes them into the data memory (WS-MEM). The image 
data to be interpreted, the previous image data, the hearing information, and the information attached to an examination 
and an image are memorized conrresponding to each examined person. 

(2) Display of Image 

[0431] The workstation (WS) displays the images to be interpreted. Now, as two display units (WS-DISP) are pro- 
vided, a sheet of image to be interpreted (the examination ID number 920007) is automatically displayed on the left- 
sided display unit (WS-DISP). Also, when an image is displayed on the display unit (WS-DISP), its examination ID 
number (existent in the information attached to an image) is displayed. 

(3) Input of interpretation findings 

[0432] From the Interpretation to input of findings as the results, the following procedures are carried out: 

(a) An interpreting doctor reads the displayed images. 

When the interpreting doctor displays images and interprtation reports other then the displayed one. he/sf le 
inputs a com-mand for it from the input unit (WS-INPUT) and operates. 

(b) When the interpreting doctor finishes interpreting the image, he/she points out a position of pulmonary nodulous 
shadows on the image to be interpreted with a mouse. 

The control unit (WS-CTRL) reads out the coordinates of the position of the abnormality inputted to store It. and 
creates a finding data table as shown in Fig. 30, Then, the image display manager (WS-IDM) aeates overlay dis- 
play information describing "arrow, cooidinares of the position of an abnormality, white, and display" as to the 
abnomiality in each finding number referring to the finding data table. The aeated overiay display information is 
shown In Fig. 31. The image display manager (WS-IDM) creates an overiay according to the overiay display infor- 
mation to display it. As a result, an an-ow is displayed in a position that a doctor indicates on the image. The control 
unit (WS-CTRL) writes the overlay display information created into the data nnemory (WS-MEM) corresponding to 
the examinatfon ID number. 

(c) When an interpreting doctor recognizes an abnomiality other than the pulmonary nodules, he/she inputs an 
abnonnality type selecting command from the input unit (WS-INPUT) to select the corresponding type of an abnor- 
mality among several types of abnormality type displayed. Next, when he/she inputs the posi-tion of abnormalities, 
a method of inputting the position of abnormalities Is different according to the type of abnormalities. For example, 
in an Interstitial lung disease, he/she inputs a scope of an abnormality by enctosing it with a closed curved line by 
using a mousa In this case, the control unit (WS-CTRL) memorizes an area instead of the position. 

A doctor carries out the same operations and adds informatfon relating to an abnormality to an overiay to be 
memorized and displays on tiie imaga 

(d) When an interpreting doctor inputs all discovered abnormalities, he/she inputs an Interpretation completing 

command. 

[0433] When an abnormality Is inputted into the finding data table, the control unit (WS-CTRL) vmtes the diagnosed 
results of the entire image as an "abnormality'' into the finding date table, and when an abnormality is not inputted into 
the finding data table, the control unit (WS-CTRL) writes tiie diagnosed results of the entire image as a "normality" into 
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the finding data table to memorize into the data memory (WS-MEM). 
(4) Write of the finding data into optical magnetic disk 

[0434] The control unit (WS-CTRL) reads out the finding data tables concerning all the images to be Inetrpreted from 
the data memory (WS-MEM) and writes Into the optical magnetic disk inserted into the optical magnetic disk drive (WS- 
MODD). 

[0435] These operations in Section 5, Subsections (1) to (4) are carried out. 
6. Output of Interpretation Results 

(1) Registration of the finding data into the database 

[0436] An operator inserts the optical magnetic cfisk registering tiie finding data table into the optical magnetic drive 
(DB-MODD) of the database (DB), and inputs a findng data readout command of the optical magnetic disk from the 
input unit (DB-INPUT). Then, by an instruction of the control unit (DB-CTRL), the optical magnetic disk drive (DB- 
MODD) reads out the finding data table registered in the optical magnetic disk, and writes into the data storing unit (DB- 
STRG). The control unit (DB-CTRL) extracts directory information from the fading data table to send to the search unit 
(DB-SRCH). The search unit (DB-SRCH) stores the received directory information. 

[0437] The data registered in another optical magnetic disk are also registered in the database in the same manner 
as the above operations. Thus, the two doctors' finding data as to the identical examination image are inputted into the 
database. 

(2) Extraction of a person required to make a dose examination 
[0438] 

(i) An operator inputs a dose examination required person extracting command from the input unit (DB-INPUT) of 
the database (DB). Then, by an instruction of the control unit (DB-CTRL). the search unit (DB-SRCH) searches the 
finding data tables of a chest X-ray examination in which the overall judgements of the interpretation results Oudge- 
ments whether or not the close examination is necessary) are not made, the control unit (DB-CTRL) reads out the 
examined patient identification information and the diagnosed results information of two doctors in the system 
memory. 

(ii) The control unit (DB-CTRL) extracts the two doctors' diagnosed results of each examined patient from the find- 
ing data table and compares each other. If one of tiie two doctors' diagnosed results is "abnormal", the overall 
judgements are made as an "abnormality", and when the both are "normal", the overall judgements are made as a 

"normality". 

[0439] TTie overall judgement results are associated witti the examined patient Identification information to be trans- 
ferred to the data storing unit (DB-STRG) and the search unit (DB-SRCH) to be stored. 

(3) Outputs of tiie interpretation results 

[0440] The control unit (DB-CTRL) reads out the overall judgements from the data storing unit (DB-STRG). and after 
the results of the overall judgements: 

[0441] In the case where the overall judgement results are normal", the overall judgement results are associated with 
the examined patient identification information and the name of tine examined patient to write into the optical magnetic 
disk D. 

[0442] In the case where the overall judgement results are "abnormal", the control unit (DB-CTRL) indicates the 
search unit (DB-SRCH) to search images to be interprrted from the data storing unit (DB-STRG) to read out. The two 
doctors' finding data tabia the overall judgements, and the images to be interpreted are associated with the examined 
patient identification information and the name of the examined patient to write into the optical magnetic disk D. 
[0443] The optical magnetic disk D is canled to the patient reported. 

[0444] At this time, a flow of the series of system operations for interpreting a chest X-ray image in the lung cancer 
examination is completed. 
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Embodiment No. 5-2 

[0445] Applications to Interpreting supports in the lung cancer group examination will be picked up in the same man- 
ner as the embodiment Na 5-1. As Sections 1, 2, and 3 in a flow of a series of system operations for the interpretation 
are entirely same as the embodiment Na 5-2, the description Is omitted. The follcwing will be described: 

4. Only a part of the preparation of Image data will be described. 

5. The interpretaion of in^ge data 

6. The output of interpretation results 

[0446] However, in this embodiment as the embodiment in which the data to be Interpreted by the doctor are output- 
ted in a form of the examined patient identification information which Is a type of the Identification information of the 
medical image data, the optical magnetic disk registering all the image data in 2. Acquisition of the Chest X-ray Image, 
(3) VWIte of the data into the optical magnetic disk Is called an optical magnetic disk X. This optical magnetic disk X is 
used for communicating the image data with tiie database (DB) etc. 

4. Preparation of Interpreting Data 

(1) Detection of an abnormality from an image using a plurality of algorithms 
[0447] 

(i) When finishing registering the data, the control unit (DB-CTRL) of ttie database (DB) indicates the search unit 
(DB-SRCH) to search the registered images (images to be interpreted and previ-ous Images) to obtain a response. 
Successively, the control unit (DB-CTRL) indicates to perform the following abnormality detecting operations each 
sheet of Images. The abnormality to be detected is shadows of pulmonary nodules and an interstitial lung disease. 
Herein, by using the algorithm as described In literatures concerning tiie CAD described in tiie column of tiie prior 
art an abnormality Is detected. That is. as to an interstitial lung disease, two detecting algorithms of tiie literatures 
(1). (4). and (5) shall be used, and as to pulmonary nodules, two algorithms of the literatures (2). (6). (7). and (8) 
shall be selected and used. 

(il) Image data con-esponding to a sheet of image are read out from ttie data storing unit (DB-STRG) and sent to 
ttie image processing unit (DB-IP). The image processing unit (DB-IP) receives the image data and operates pul- 
monary nodule shadow detecting means by using a first algorithm stored inside to detect presence or absence of 
tiie abnormalities. The detected results are written into an abnormality data table as first detected results of the pul- 
monary nodules. Next, by operating the pulmonary nodule shadow detecting means by a second algoritiim to 
detect presence or absence of the abnormalities. The detection results are. in the same menner, written into the 
abnormality data table as second detection results of tiie pulmonary nodules. The Images of ttie examination ID 
number 930001 are "abnormar in the first detection results, and also "abnormal" in the second detection results, 
(iii) The image processing unit (DB-IP) operates, In ttie same manner as the pulmonary nodules, the pulmonary 
interstitial disease detecting means by using ttie first algoritfim stored inside and the pulmonary interstitial disease 
detecting means by using ttie second algorittim to write ttie detected results into ttie abnormality data table as the 
first and second detectton results of ttie pulmonary Interstitial disease. In the images of the examination ID number 
930001 , tiie first detection results were "normal" and ttie second detection results were "abnormal". 

[0448] The abnormality data table conceming the Image of ttie examination ID number 930001 is shown in Fig. 84. 
In ttiis connection, Nodule in ttie figure denotes pulmonary nodules and ILD denotes a pulmonary interstitial disease. 

(2) Classification of data according to ttie detected abnormalities 
[0449] 

(i) The control unit (DB-CTRL) compares respective abnormality detected results of ttie abnomiality data table 
each type of ttie abnormality. The types of the detected abnormalities are ttie pulmonary nodules and pulmonary 
Interstitial disease. The results detected by using two algorithms each type of the abnormality are classified as fol- 
lows: This is called a first classification. 

Case 1 : The case where botti of ttie first detected results and the second detected results are "normar. 
Case 2: The case where one detected result is "abnormal" and ttie other detected results are "normal". 
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Case 3: The case where both of the first detected results and the second detected results are "abnormal". 



Next, the aboveHtientioned classified results are compared each type of the abnormality to classify as follows: 
5 This is called a second classification. 

Case A: The classified results of the type of all abnormalities have been classified in the case 1 . 
Case B: There exists even one of the types of the abnormality classified in the case 3. 
Case C: This case does not fall under both of the case A and the case B. 

70 

The data falling under the cases A, B. and C are listed to register into lists A, B, and 0. 

(ii) As an embodiment of the classification, the classification of the image of the examination ID number 930001 will 
be described. The results of the pulmonary nodules in the abnormality data table as shown in Fig. 84 fall under the 
case 3 in the first classification since both of the first detected results and the second detected results are "abnor- 

75 mal". Also, the results of the interstitial lung disease in the abnormality data table as shown in Fig. 84 fail under the 
case 2 in the first classification since the first detected results are "normal" and the second detected results are 
"abnormal". Accordingly, the data fall under the case B in the second classification. 

(iii) The classified results of the images of the examination ID numbers 930001 to 930010 are shown in Fig. 85. 
Also, the examination ID numbers in which the second classified results fall under the case A, the case B. and the 

20 case C are respectively registered in the list A. the list B. and the list C. The created list A. list B. and list C are 
shown in Rgs. 86. 87, and 88. 

(3) Preparation of interpreting data 

25 [0450] 

(i) When the abnormality detecting processing from the images is finished, the conb-ol unit (DB-CTRL) associates 
the list C, and the previous image data, tiie hearing infomiation. and the information attached to an examination 
and an image (containing the abnormality data table) of the examined patient identification inlbrmation con^espond- 

30 ing to ttie examination ID number registered in tills list C. and the examined patient identification information and 
the name of tiie examined patient corresponding to the examination ID number registered in the list C. and tiie 
abnormality data table witii each other. The control unit (DB-CTRL) indicates the data storing unit (DB-STRQ) to 
read out and indicates the optical magnetic disk drive (DB-MODD) to write. The data storing unit (DB-STRG) reads 
out these data and sends to tiie image bus (DB-IBUS). The optical magnetic drive (DB-MODD) receives these data 

35 and writes into the optical magnetic disk C. 

(ii) The control unit (DB-CTRL) associates the examined patient idetification information, tfie name of the examined 
patient, and the abnormality data table corresponding to the examination ID number registered in the list B with 
each other, and indicates tiie optical magnetic disk drive (DB-MODD) to write tiie overall judgement results as an 
"abnormality". Then, the data storing unit (DB-STRG) reads out tiiese data to send to ttie image bus (DB-IBUS). 

40 The optical magnetic disk drive (DB-MODD) receives these data to write into the optical magnetic disk B. 

(iii) The control unit (DB-CTRL) associates ttie examined patient identification information and tiie name of tiie 
examined patient con'esponding to tiie examination ID number registered in the list A with each ottier and indicates 
the optical magnetic disk drive (DB-MODD) to write the overall judgement results as a "normality". Then, the data 
storing unit (DB-STRQ) reads out ttiese data to send to the image bus (DB-IBUS). The optical magnetic disk drive 

45 (DB-MODD) receives ttiese data to write into ttie optical magnetic disk B. 

[0451] The optical magnetic disk B is carried to ttie patient to be reported to make such a report recommending the 
patient who is reported ttie overall judgement results "abnormality" to make a dose examination. 
[0452] In ttie medical group examination, the interpretation is earned out by two doctors. Accordingly, two sets con- 
so sisting of two sheets of optical magnetic disk C and X are prepared to carry each set to each of the two wori«tations 
(WS). 5. Interpretation of Image Data(1) Input of interpreting data into workstation (WS) 

[0453] An operator inserts tiie optical magnetic disk C registering ttie list C, and ttie previous image data, ttie hearing 
information, and the information attached to an examination and an image in relation to the examination ID number 
desCTibed in ttiis list C. and the examination ID number, ttie examined patient identification information, and tiie name 
55 of tiie examined patient con-esponding to each other, and ttie abnormality data table into the optical magnetic disk drive 
(WS-MODD), and inputs a data readout command from ttie optical magnetic disk C from the input unit (WS-INPUT). 
Then, by an instruction of ttie control unit (WS-CTRL). ttie optical magnetic disk drive (DB-MODD) reads out ttie data 
stored in ttie optical magnetic disk C and writes ttiem into ttie data memory (WS-MEM). Furthermore, an operator 
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inserts the optical magnetic disk X registered in all the examination image data into the optical magnetic disk drive (WS- 
MODD) of the workstation (WS), and inputs a readout command of the image data to be interpreted con^esponding to 
the examination ID number regis-tered in the list C from the input unit (WS-INPUT). Then, by an instruction of the con- 
trol unit (WS-CTRL). the optical magnetic disk drive (WS-MODD) reads out the image data registered in the list C from 
the optical magnetic disk X. and writes into the data memory (WS-MEM). Thus, the image data to be interpreted, the 
previous image data, the hearing information, and the infbrmation attached to an examination and an image are mem- 
orized corresponding to each examined person. 

(2) Display of Image 

[0454] The workstation (WS) displays the images to be interpreted. Now, as two display units (WS-DISP) are pro- 
vided, a sheet of image to be interpreted (the examination ID number 920002) is automatically displayed on the left- 
skied display unit (WS-DISP). Also, when an image is displayed on the display unit (WS-DISP). its examinatfon ID 
number (existent in the information attached to an image) is displayed. 

(3) Input of interpretation findings 

[0455] From the interpretation to inputs of findings as the results, the following procedures are can^ied out: 

(a) An interpreting doctor reads the displayed images. 

When the interpreting doctor displays images and interprtatk3n reports other then the displayed one, he/she 
inputs a command for it from the input unit (WS-INPUT) and operates. 

(b) When the interpreting doctor finishes interpreting the image, he/she points out a position of pulmonary nodulous 
shadows on the image to be interpreted with a mouse. 

The control unit (WS-CTRL) reads out the coordinates of the position of the abnormality inputted to store it, and 
creates a finding data table. The created finding data table are written into the data memory (WS-MEM) con'e- 
sponding to the examination ID number. 

(c) When an interpreting doctor recognizes an abnormality other than the pulmonary nodules, he/she inputs an 
abnonnality type selecting command from the input unit (WS-INPUT) to select the corresponding tyep of an abnor- 
mality among several types of abnormality type displayed. Next, when he/she inputs the position of abnormalities, 
a method of inputting the position of abnormalities is different according to the type of abnormalities. For example, 
in a pulmonary interstitial disease, he/she inputs a scope of an abnormality by enclosing it with a closed curved line 
by using a mouse, in this case, the control unit (WS-CTRL) memorizes an area instead of the position. 

(d) When an interpreting doctor inputs all discovered abnormalities, he/she inputs an interpretation completing 
command. 

When an abnormality is inputted into the finding data table.the conti-ol unit (WS-CTRL) writes the diagnosed 
results of the entire image as an "abnormality'' into the finding data table, and when an abnomiality is not inputted 
into the finding data table, tiie control unit (WS-CTRL) writes the diagnosed results of the entire image as a normal- 
ity" into the finding data table to memorize into the data memory (WS-MEM). 

(4) Write of the finding data Into optical magnetic disk 

[0456] The control unit (WS-CTRL) reads out the finding data tables concerning all the images to be interpreted from 
the data memory (WS-MEM) and writes into the optical magnetic disk inserted into tiie optical magnetic disk drive (WS- 
MODD). 

[0457] These operations in Section 5, Subsections (1) to (4) are carried out at two locations. 

6. Output of Interpretation Results 

(1) Registration of the finding data into the database 

[0458] An operator inserts the optical magnetic disk registering the finding data table into the optical magnetic drive 
(DB-MODD) of the database (DB), and inputs a finding data table readout command of the optical magnetic disk from 
the input unit (DB-INPUT). Then, by an instruction of the control unit (DB-CTRL), the optical magnetic disk drive (DB- 
MODD) reads out the finding data table registered in the optical magnetic disk, and writes Into the data storing unit (DB- 
STRG). The control unit (DB-CTRL) extracts directory information from the finding data table to send to the search unit 
(DB-SRCH). The search unit (DB-SRCH) stores the received directory infomiation. 

[0459] The data registered in another optteal magnetic disk are also registered in the database in the same manner 
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as the above operations. Thus, the two doctors' finding data as to the identical examination Image are inputted into the 
datatiase. 

(2) Extraction of a person required to make a dose examination 
[0460] 

(i) An operator Inputs a dose examination required person extracting command from the Input unit (DB-INPUT) of 
the database (DB). Then, by an instruction of the oontrd unit (DB-CTRL). the search unit (DB-SRChO searches the 
finding data tables of a chest X-ray examination in which the overall judgements of the interpretation results (judge- 
ments whether or not the dose examination is necessary) are not made, the control unit (DB-CTRL) reads out the 
examined patient identification infbmiation and the diagnosed results information of two doctors In the system 
memory. 

(ii) The control unit (DB-CTRL) extracts the two doctors' diag-nosed results of each examined patient from the find- 
ing data table and compares each otiier. If one of the two doctors' diag-nosed results is "abnormar, tiie overall 
judgements are made as an "abnormality", and when the botti are "normal", the overall judgements are made as a 
"normality". 

[0461] TTie overall judgement results are associated with the examined patient Identification information to be trans- 
ferred to the data storing unit (DB-STRG) and the search unit (DB-SRCH) to be stored. 

(3) Output of the interpretatbn results 

[0462] The control unit (DB-CTRL) reads out the overall judgements from the data storing unit (DB-STRG), and after 

the results of the overall judgements: 

[0463] In the case where the overall judgement results are "normal", the overall judgement results are assodated witfi 
the examined patient identification information and the name of ttie examined patient to write into the optical magnetic 
dIskD. 

[0464] In the case where the overall judgement results are "abnormal", the control unit (DB-CTRL) indicates the 
search unit (DB-SRCH) to search images to be interpreted from the data storing unit (DB-STRG) to read out. The two 
doctors' finding data table, the overall judgements, and the images to be Interpreted are associated with the examined 
patient identlficatron information and the name of the examined patient to write into the optical magnetic disk D. 
[0465] The optical magnetic disks D and X are canrled to the patient reported. 

[0466] At this time, a flow of the series of system operations for interpreting a chest X-ray image in the lung cancer 
examination is completed. 

Embodiment No. 5-3 

[0467] Applications to Interpreting supports in the lung cancer group examination will be taken up in the same manner 
as the embodiment no. 5-1 . As Sections 1,2,3, 5. and 6 in a flow of a series of system operations for the interpretation 
are entirely same as the embodiment l, only a part of 4. Preparation of Interpreting Data will be explained. 

4. Preparation of Interpreting Data 

(1) Computation of a characteristic value of an image 

[0468] 

(i) When finishing registering the data, the control unit (DB-CTRL) of the database (DB) indicates the search unit 
(DB-SRCH) to search the registered innages (images to be Interpreted and prevl-ous images) to obtain a response. 
Successively, the control unit (DB-CTRL) indicates to perform tiie following abnormality value operations each 
sheet of images. The computed abnormality value is shadows of pulmonary nodules and an interstitial lung dis- 
ease. Herein, a method of computing a characteristic value will be explained. 

In the case of ttie pulmonary nodules, after a filter is put on the image to undergo several tests, the remainder 
is deemed to be tiie abnonnal shadows. Then, as to all the image in the database (DB). the number of candidate 
of the abnormal shadows which have passed each test is seeked and a set which makes it a population is seeked. 
In the objective image, tfie number of candidate of the abnormal shadows which have passed each test is seeked 
and each deviation value is seeked. A mean value of the deviation value is deemed to be an abnormal value con- 
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cerning the pulmonary nodules. 

In the case of the interstitial lung disease, with reference to the literatures, about twenty regions of Interest 
(ROI) is set on the image, and its inside is made a texture analysis to okrtain a single Index, and the judgemnent of 
an abnormality or a normarity is made by the value. Then, as to all images in the database (DB), a set in which the 
single index of the upper five ROIs of each image is a population is seeked. The upper five values of the single 
index of each ROI of the objective image are seeked. The deviatk>n value of the five single Indexes in the previously 
acquired set is seeked, and the mean value of five deviation values is an abnormal value concerning the pulmonary 
interstitial disease. 

As compared with the abnormal value acquired each type of each disease, the maximum value is deemed to 
be a characteristic value of the image. 

(ii) The data storing unit (DB-STRG) reads out a sheet of image data and sends to the image processing unit (DB- 
IP). The image processing unit (DB-IP) receives image data and operates the pulmonary nodule detecting means 
stored inside, and stores the number of candidate of abnormal shadows in each stage. Next, the image processing 
unit (DB-IP) acquires a deviation value in a population as to respective values, and further acquires a mean value 
of the acquired deviation value which is an abnormal value concerning the pulmonary nodules. The acquired 
abnormal value is written into the aljnormality data table. Each computed value as shown in Fig. 89 is referred to 
before the abnormality data table concerning the image of the examination ID number 940001 is seeked. 
(iil)The image processing unit (DB-IP) operates the pulmonary interstitial disease delecting means stored inside in 
the same manner as the pulmonary nodules, and computes the single index of each ROI. Next, the upper five val- 
ues are acquired, Alsa a deviation value in a population as to respective values is aquired. Further, the mean value 
of the acquired deviation value is acquired to be an abnormal value concerning the interstitial lung disease. The 
aquired abnormal value is written into the abnormality data table. Each computed value as shown in Fig. 90 is 
referred to before the abnormality data table concerning the image of the examination ID number 940001 is 
acquired. 

(iv)ln the acquired abnormal value, the pulmonary nodules are 73.75, and the interstitial lung disease is 70.84. 
Accadingly, the maximum value is 73.75, which is written into the abnormality data table as a characteristic value 
of the image of the examination ID number 940001 . The abnormality data table of the image of the examination ID 
number 940001 is shown in Fig. 91 . 

(2) Classification of data con-esponding to the computed characteristic value (i) The control unit (DB-CTRL) compares 
two set 

[0469] 

points X. Y (X<Y) which are beforehand deckied as to the characteristic value of the image of the abnormality data 
table, and the classification will be made as follows: 

Case A: The characteristic value of the image is less than a set point X. 

Case B: The characteristic value of the image is a set point Y a more. 

Case C: The characteristk: value of the image is a set point X or more and less than a set point Y. 

The image data falling under the cases A. B, and C are respectively listed and registered in the lists A. B and 

C. 

(ii] As an embodiment of the clasification, the classification of the image of the examination ID number 940001 will 
be described. The characteristic value of the image of the abnormality data table as shown in Hg. 91 is 73.75. The 
set points X. Y are respectively set as follows: 

Set point X =r 32.00. Set point Y = 68.00 



Accordingly, this l^ts under the case B in the classification. 
(iii)The classified results of the images of the examination ID numbers 940001 to 940010 are shown in Fig. 92. 
Also, the examination ID numbers in which the classified results fall under the case A, the case B, and the case C 
are respectively registered in the list A, the list B, and the list C. The aeated list A. Ust B. and list C are shown in 
Rgs. 93. 94. and 95. 
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(3) Preparation of interpreting data 
[0470] 

5 (i) When finishing the abnormality detecting processing from the images, the control unit (DB-CTRL) indicates the 
data storing unit (DB-STRG) to read out the image data to be interpreted, the previous image data, the hearing 
information, and the information attached to an examination and an image (containing the abnormality data table) 
of the examination ID number registered in the list C. and indicates the optical magnetic disk drive (DB-MODD) to 
writa The data storing unit (OB-STRG) reads out these data to send to the image bus (DB-IBUS). The optical mag- 

TO netic d^k drive (DB-MODD) receives these data to write into the optical magnetic disk C. 

(ii) The control unit (DB<}TRL) associates the examined patient idetification information, the name of the examined 
patient, and the abnormality data table corresponding to the examination ID number registered in the list B with 
each other, and indicates the optical magnetic disk drive (DB-MODD) to wtite the overall judgement results as an 
"abnormality". Then, the data storing unit (DB-STRG) reads out these data to send to the image bus (DB-IBUS). 

IS The optical magnetic disk drive (DB-MODD) receives these data to write into the optical magnetic disk B, 

(iii) The control unit (DB-CTRL) associates the examined patient Identification information and the name of the 
examined patient conesponding to the examination ID number registered in the list A with each other and indicates 
the optical magnetic disk drive (DB-MODD) to write the overall judgement results as a "normality". Then, the data 
storing unit (DB-STRG) reads out these data to send to the Image bus (DB-IBUS). The optical magnetic disk drive 

20 (DB-MODD) receives these data to write into the optical magnetic disk B. 

[0471 ] The optical magnetic disk B is carried to the patient to be reported to make such a report recommending the 
patient who is reported the overall judgement results "abnormality" to make a dose examination. 
[0472] In the medical group examination, the Interpretatnn is carried out by two doctors. Accordingly, two sheets of 
25 optical magnetic disk C are prepared to cany each sheet to each of two wori<stations (WS). 
[0473] The succeeding operations are same as the embodoment No. 5-1 . 

[0474] Next, in the embodiments no. 6-1 and na 6-2 concerning the first and second variation for the sixth embodi- 
ment according to the present invention, a series of system operations will be described in detail. 

30 Embodiment No. 6-1 

[0475] Even in this embodiment, as a series of system operations 1 , 2, and 3 are entirely identical to the embodiment 
1 , the description is omitted. The fbltowing will be described: 

35 4. Preparation of interpreting data 

5. Interpretation of imaging data 

6. Output of interpretation results 

[0476] Then, the embodiment in which the interpretaion of a chest X-ray image in the identical lung cancer examina- 
40 tion to the embodiment no. 5-1 is earned out will be described below. 

4. Preparation of Interpreting Data 

(1) Detection of an abnormality from an image using a plurality of threshoM values 

45 

[0477] 

(i) When finishing registering the data, tiie control unit (DB-CTRL) of ttie database (DB) indicates the search unit 
(DB-SRCH) to search the registered images (images to be interpreted and previous images) to obtain a response. 

so Successively, the control unit (DB-CTRL) indicates to perform tiie following abnormality detectirtg operations each 
sheet of images. The abnonmality to be detected is shadows of pulmonary nodules and an interstitial lung disease. 
Herein, the metfiod of setting a tfireshold value is same as tfie embodiment no. 5-1 . That Is. as to various types of 
an abnormality, two ttireshofd values can respectively be applied, and the first threshold value is set so as to be 
narrow in tiie scope of a normality and the second threshold value is set so as to be nanow in ttie scope of an 

55 abnormality. The respective scopes cover the high probability of a normality and an abnormality. 

(ii) Image data corresponding to a sheet of image are read out from the data storing unK (DB-STRG) and sent to 
the image processing unit (DB-IP). The image processing unit (DB-IP) receives ttie image data and operates pul- 
monary nodules shadow detecting means by using a first threshold value stored inside to detect presence or 
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absence of the abnormalities. The detected results are written into an abnorniatity data table as first detected 
results of the pulmonary nodules. The image of the exarrtnation ID number 920001 is judged to be "abnormal". 
Next, by operating the pulnwnary nodule shadow detecting means by using a second threshold value to detect 
presence or absence of the abnonnalities. The detected results by the pulmonary nodules shadow detecting 

5 means by using the second threshold value are written into the abnormality data table as the second detection 
results of the pulmonary nodules. The Image of the examination ID number 920001 Is judged to be "abnormal'. 
(iii)The image processing unit (DB-IP) operates, in the same manner as the pulmonary nodules, the interstitial lung 
disease detecting means stored inside by using the first threshold value and the pulmonary interstitial disease 
detecting means by using the second threshold value to detect presence or absence of the abnormality. The 

10 detected results are written into the abnw mality data table as the first and second detection results. The image of 
the examination ID number 920001 is "abnormal" in the pulmonary interstitial disease detecting means by using 
the first threshold value, and "normal" in the pulmonary interstitial disease detecting means by using the second 
threshold value. 

IS [04781 The abnormality data table concerning the image of ttie examination ID number 920001 is shown in Fig. 96. 
In this connection. Nodule in the figure denotes pulmonary nodules and ILD denotes an interstitial lung disease. 

(2) Classification of data according to the detected abnormalities 

20 [0479] 

(i) The control unit (DB-CTRy compares respective abnormality detected results of the abnonnality data table 
each type of tfie abnormality. The types of the detected abnormalities are the pulmonary nodules and pulmonary 
interstitial disease. The results detected by using two threshold values each type of tiie abnormality are classified 
25 as follows: This is called a first classification. 

Case 1 : The case where both of the first detected results and the second detected results are "normar. 
Case 2: The case where one detected results is "abnormal" and the other detected results are "normal". 
Case 3: The case where both of the first detected results and the second detected results are "abnormal". 

30 

Next, the above-mentioned classified results are compared each type of the abnormality to classify as follows: 
This is called a second classirication. 

35 Case A: The classified results of the type of all abnormalities have been classified in the case 1 . 

Case B: There exists even one of the types of the abnormality classified in the case 3. 
Case C: This case does not fall under both of ttie case A and the case B. 

The data falling under the cases A. B. and C are listed to register into lists A. B. and C. 

40 (ii) As an embodiment of the classification, ttie classification of the image of ttie examination ID number 920001 will 
be described. The results of ttie pulmonary nodules in ttie abnormality data table as shown in Fig. 96 faW under ttie 
case 3 in ttie first classification since botti of the first detected results and the second detected results are "abnor- 
mal". Also, the results of ttie pulmonary interstitisi disease in the abnormality data table as shown in Fig. 96 fall 
under ttie case 2 in ttie first classification since ttie first detected results are "normal" and ttie second detected 

45 results are "abnormar Accordingly, the data fall under ttie case B in tiie second classification. 

(iii)The classified results of the images of ttie examination ID numbers 920001 to 920030 are shown in Fig. 97. 
Also, the examination ID numbers in which ttie second classified results fall under the case A, ttie case B, and ttie 
case C are respectively registered in ttie list A. the list B, and ttie list C. The created list A. list B, and list C are 
shown in Figs. 98, 99 and 100. 

so 

[0480] Out of ttie image data registered In ttie lists created, ttie image data regfetered in ttie list A and list B are 
respectively judged to be "normal" and "abnormal" to be reported. The image data registered in ttie remaining list C are 
required a doctor's interpretation. 

55 
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(3) Re-detection off an abnomnality from the interpreting image 
[0481] 

(I) When finishing registering the lists, the control unit (DB-CTRL) indicates (instructs) the search unit (DB-SRCH) 
to search the image registered in the list C (an Image to be interpreted and a previous image) to obtain a response. 
Successively, the following abnormality detecting operations are earned out again for each sheet of image. The 
detected abnormalities are the pulmonary nodule shadows and interstitioal dfeease. A third threshold value to be 
used this time fe not as narrow in the scope of a normality as in the first threshold value, and the third threshold 
value is not as narrow in the scope of an abnormality as in the second threshold value. The third threshold value is 
such that H has a true positive fraction to a degree that the doctor can check the overlookedness, and at the same 
time a false positive fraction becomes a minimum. In other words, the third threshold value to be used this time Is 
suitable for a diagnosis of the substantially same level as the level of the doctor's diagnosis. 

(ii) A sheet of image data is read out from the data storing unit (DB-STRG) to send to the image processing unit 
(DB-IP). The image processing unit (DB-IP) receives the image data and operates the pulmonary nodule shadow 
detecting means using the third threshold value stored inside to detect presence or absence of an abnormality and 
its position in the case of the abnormality. The detected results are written into the abnormality detailed data table 
as the abnormality detailed detection results of the pulmonary nodules. 

(iii) The Image processing unit (DB-IP) operates, in the same manner as the pulmonary nodules, the pulmonary 
interstitial disease detecting means using the third threshold value stored inside and detects presence or absence 
of the abnormality and Its position In the case of the abnormality The detected results are written Into the abnor- 
mality detailed data table as the abnormality detailed detection results of the interstitial lung disease. 

(iv) In the case where the abnormality is detected in any abnormality detecting operations, the CAD processed 
results are written into the abnormality detailed data table as an "abnormality", and in the case where the abnor- 
mality is not detected even in any abnormality detecting operations, the CAD processed results are written into the 
abnormality detailed data table as a "normality". 

[0482] The abnonnality detailed data table concerning the image off the examination ID number 920002 is shown in 
Fig. 101. 

[0483] As described above. Paragraphs (ii) to (iv) of Subsection (3) are repeated for all the images registered In the 
list C. At a doctor's interpretation, the abnomiality detailed data table or the like of the CAD processed results is referred 
to and used for a disgnosis. 

(4) Preparation of interpreting data 
[0484] 

(0 When the abnormality detecting processing from the images is finishing, the control unit (DB-CTRL) Indicates 
the data storing unit (DB-STRG) to read out the image data to be interpreted, the previous image data, the hearing 
information, the abnormality detailed data table, and the information attached to an examination and an image of 
the examination ID number registered in the list C. and indicates the optical magnetic disk drive (DB-MODD) to 
write them. The data storing unit (DB-STRG) reads out these data and sends to the Image bus (DB-IBUS). The 
optical magnetic drive (DB-MODD) receives these data and writes into the optical magnetic disk C. 

(ii) The control unit (DB-CTRL) associates the examined patient idetlfication information, the name of the examined 
patient, and the abnormality data table corresponding to the examination ID number registered in the list B with 
each other, and indicates the optical magnetic disk drive (DB-MODD) to write the overall judgement results as an 
"abnormality". Then, the data storing unit (DB-STRG) reads out these data to send to the Image bus (DB-IBUS). 
The optical magnetic disk drive (DB-MODD) receives these data to write into the optical magnetic disk B. 

(iii) The control unit (DB-CTRL) associates the examined patient identification infomiation and the name of the 
examined patient con^esponding to the examinatfon ID number registered in the list A with each other and indicates 
the optical magnetic disk drive (DB-MODD) to write the overall judgement results as a "normality". Then, the data 
Storing unit (DB-STRG) reads out these data to send to the image bus (DB-IBUS). The optical magnetic disk drive 
(DB-MODD) receives tiiese data to write into the optk»l magnetic disk a 

[0485] The optical magnetic disk B is carried to the patient to be reported to make such a report recommending the 
patient who is reported the overall judgement results "abnormality" to make a dose examination. 
[0486] In the medical group examination, the Interpretation is carried out by two doctors. Accordingly, these two 
sheets of optical magnetic disk C are prepared and are carried to workstations (WS). 5. Interpretation of Image Data 
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(1) Input of Interpreting Data into Wbrkstatlon (WS) 

[0487] An operator Inserts the optical magnetic disk C registering the image data to be Interpreted, the previous image 
data, the hearing information, and the information attached to an examination and an image into the optical nragnetic 
disk drive (WS-MODD) of the workstation (WS), and inputs a data readout command from the optical magnetic disk C 
from the input unit (WS-INPUT). Then, by an instruction of the control unit (WS-CTRL). the optk^l magnetic disk drive 
(DB-MODD) reads out the data stored in the optical magnetic disk C and writes them into the data memory (WS-MEM). 
The image data to be interpreted, the previous image data, the hearing intormation) the abnormality detailed data table, 
and the information attached to an examination and an image are stored ooffesponding to each examined patient. 

(2) Display of Image 

[0488] The workstation (WS) displays the images to be inetrpreted. Now. as two display units (WS-DISP) are pro- 
vkJed, a sheet of image to be interpreted (the examination ID number 920002) is automatically displayed on the left- 
skied display unit (WS-DISP). Also, when an image is displayed on the display unit (WS-DISP). its examination ID 
number (existent in tiie Information attached to an image) is displayed. 

(3) Input of interpretation findings 

[0489] From the Interpretation to inputs of findings as tiie results, the following procedures are carried out: 

(a) An interpreting doctor reads the displayed images. 

When the interpreting doctor displays images and interprtation reports other then «ie displayed one, he/she 
inputs a com-mand for it from the input unit (WS-INPUT) and operates. 

(b) When the interpreting doctor finishes interpreting tiie image, he/she points out a position of pulmonary nodulous 
shadows on the image to be interpreted with a mouse. 

The control unit (WS-CTRL) reads out the coordinates of the position of tiie abnomiality inputted to store it, and 
creates a finding data table as shown in Fig. 102. Then, the image display manager (WS-IDM) refers to the finding 
data table and creates the overlay display information describing "arrow, coordinates of the position of an abnor- 
mality, white, display" in the abnoranHity of each finding number. The created overlay display infomiation is shown 
in Fig. 103. The image display manager (WS-IDM) creates the overlay according to the overlay display information 
and displays. As a result, an arrow is displayed in a position that a doctor points out on the image. The control unit 
(WS-CTRL) associates the aeated overlay display information with the examination ID number and writes it into 
the data memory (WS-MEM). 

(c) When an interpreting doctor recognizes an abnonnality other than the pulmonary nodules, he/she inputs an 
abnormality type selecting command from the input unit (WS-INPUT) to select tfie corresponding type of an abnor- 
mality among several types of abnormality type displayed. Next, when he/she inputs tiie position of abnormalities, 
a method of inputting tiie position of abnormalities is different according to the type of abnormalities. For example, 
in a pulmonary interstitial disease, he/she inputs a scope of an abnormality by enclosing it witii a closed cun^ed line 
by using a mouse. In this case, the control unit (WS-CTRL) memorizes an area instead of tiie position. 

By performing the same operations, tiie information concern-Ing the abnormality Is added to tiie overlay and 
stored to display on tiie Image. 

(d) When an interpreting doctor inputs all discovered abnormalities, he^he inputs an interpretation completing 

command. 

[0490] When an abnormality is inputted into the finding data table.the cortrol unit (WS-CTRL) writes tfie diagnosed 
results of the entire Image as an "abnormality" into the finding data table, and when an abnormality is not inputted into 
the finding data table, ttie control unit (WS-CTRL) writes tiie diagnosed results of the entire image as a "normality" into 
the finding data table to memorize into ttie data memory (WS-MEM). 

(4) Comparison and dassrf ication of diagnostic intormation and regi^tion into an abnormality detection result list 
[0491] 

(i) The cortrol unit (WS-CTRL) reads out a finding data table which is interpretation results and an abnormality 
detailed data table from ttie data memory (WS-MEM). 

In tiie same rrwnner as ttie overlay display information is aeated from ttie finding data table in Section 5, Sub- 
section (3), ttie image display manager (WS-IDM) creates ttie overiay display information from ttie abnormality 
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detailed data table indicating that a display color is "red" and memorizes it Into the data memory (WS-MEM) corre- 
sponding to the examination IC number. The overlay display information created from the abnomiality detailed data 
table of the CAD processing results concerning the examination ID number 920002 Is shown in Fig. 104. 

The control unit (WS-CTRL) extracts both the diagnostic results of the entire image from the finding data table 
and the judged results of the entire image of the CAD processing from the abnormality detailed data table to com- 
pare the both results to classify them Into the following four cases: 

Case a: The doctor judges as an "abnormality", but the CAD judges as a "normality". 
Case b: The doctor judges as an "abnormality", and the CAD also judges as an "abnormality". 
Case c: The doctor judges as a "normality, and the CAD also judges as a "normality". 
Case d: The doctor judges as a "nornalrty", but the CAD judges as an "abnormality". 

For example, as. concerning the examination ID number 920002. the doctor judges as an "abnonrTality" and 
the CAD judges as an "abnormality", this case is classified into the case b. 

(ii) According to the above-mentioned classification results, the later operations are different. The operations are 
described below. 

(a) When classifying into the case a. no operations. 

(b) When classifying into the case b. no operations. 

(c) When classifying into the case c. no operations. 

(d) When classifying into the case d. register In the abnormality detection result list. 

[0492] Herein, "register in the abnormality detection result list" means that the control unit (WS-CTRL) reads out the 
abnormality detection result list (or creates in the case where it does not exist) and writes the examination ID number 
into the data memory (WS-MEM) to store. An example of the abnormality detection result list is shown in Fig. 105. 

(5) Display of conrparison results 

[0493] The operations corresponding to the number of all sheets of Images to be interpreted in Section 5, Subsections 
(1) to (4) are repeated. 

[0494] The control unit (WS-CTRL) extracts the disgnostic results and the judgement results for the entire image from 
the finding data table of the doctor and the abnormality detailed data table of the CAD. and the results compared and 
classified is shown in Fig. 106. The interpreted images are 19 sheets registered un the list C. The classified results 
were: 

Case a: 3 sheets Case b: 6 sheets 
Case c: 6 sheets Case d: 4 sheets 

[0495] Thereafter, the control unit (WS-CTRL) displays the classified results in Section 5. Subsection (4) in the display 
unit (WS-DISP) as shown in Rg. 107. 

(6) Re-Interpretation and reference of abnormality detection results 

[0496] A doctor inputs a reinterpreting command. Tlien. the control unit (WS-CTRL) reads out the Im^e data to be 
Interpreted which register the examination ID number in the abnormality detection result list and the information relating 
to the examined patient (the hearing information, the information attached to an examination and an Image (an abnor- 
mality detailed data table, a finding data table, an overlay display information), the previous image data) from the data 
memory (WS-MEM), and si^erimposes the image to be interpreted on the overlay meaning his/her finding to display it 
on the left-sided display unit (WS-DISP) of two display units (WS-DISP). and superimposes the image to be interpreted 
on the overlay meaning the CAD processing results concerning a specific image to display it on the right-sided display 
unit (WS-DISP). 

[0497] The doctor reads an image and compares his/her finding with the CAD processing results. 
[0498] When displaying the Images and the interpreation reports other than those displayed, the doctor inputs a com- 
mand for it from the input unit (WS-INPUT) and operates. 

[0499] When the doctor finishes interpreting the image and discovers shadows of an abnormality, he/^he points out 
its position on the image to be interpreted with a mouse. Also, he/she can cored the position of an abnormality which 
is previously pointed out with a mouse. 

[0500] Thereafter, a doctor operates in the same manner as operated in Section 5. Subsection (3), Paragraph (c) and 
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after, he/she inputs an the discovered abnormalities. The control unit (WS-CTRL) menrorizes the corrected finding data 
tat)le into the data memory (WS-MEM), and the overlay of the next image and the doctor's finding and the overlay of the 
CAD processing results, which are registered into the abnormality detection result list, are displayed in the display unit 
(WS-DISP). 

[0501] As described above, the procedures as desaibed in Subsec-tion (6) will be carried out for all the images reg- 
istered In the abnormality detection result list. 

(7) Write of finding data into the optical magnetic disk 

[0502] The control unit (WS-CTRL) reads out the finding data table concerning all the images to be Interpreted from 
the data memory (WS-MEM) and writes it into the optical magnetic disk inserted into the optical magnetic disk drive 
(WS-MODD). 

[0503] These operations in Section 5, Subsections (1 ) to (7) will be carried out at two locations. 6. Output of Interpre- 
tation Results 

(1) Registration od finding data into the database 

[0504] An operator inserts the optical magnetic disk memorizing the finding data table additionally into the optical 
magnetic disk drive (DB-MODD) of the database (DB), and inputs a finding data readout command of the optical mag- 
netic disk from the input unit (DB-INPUT). Then, by an instruction of the control unit (DB-CTRL). the optical magnetfc 
disk drive (DB-MODD) reads out the finding data memorized in the optical magnetic disk and writes into the data storing 
unit (DB-STRQ). The control unit (DB-STRL) extracts directory infbnnation from the finding data table to send to the 
search unit (DB-SRCH). The search unit (DB-SRCH) stores the received directory information. 
[0505] Another sheet of optical magnetic disk is also registered into the database (DB) in the same manner. Thus, the 
two doctors* finding data concerning the identical examination image have been inputted into the database (DB). 

(2) Extraction of persons to make a close examination 
[0506] 

(i) An operator inputs a close examination examined patient extracting command from the input unit (DB-INPUT) of 
the database (DB). Then, by an instruction of the control unit (DB-CTRL). the search unit (DB-SRCH) searches a 
finding data table of a chest X-ray examination which has not been made overall judgements of interpretation 
results Qudgements as to whether a close examina-tion Is necessary or nor), and reads out the examined patient 
identification information and the two doctors' diagnostic result information in the system memory of the control unit 
(DB-CTRL). 

(ii) The control unit (DB-CTRL) extracts the two doctors' diag-nostic results of each examined patient from the find- 
ing data table to compare. If even one of the diagnostic results of two doctors is "abnoramr, the overall judgement 
is made as an "abnormality", and if only the both are "normal", the overall judgement is made as a "normality". 

[0507] The overall judgement results are associated with the examined patient Identification information, and are 
transferred to tiie data storing unit (DB-STRG) and the search unit (DB-SRCH) to store tiierein. 

(3) Output of the interpretation results 

[0508] The control unit (DB-CTRL) reads out the overall judgements from the data storing unit (DB-STRG). According 
to results of the overall judgements, the following operations are available: 

[0509] In the case where the overall judgement results are "normal", the overall judgement results are written into the 
optical magnetic disk D corresponding to the examined patient identification information and the name of the exarraned 
patient. 

[0510] In the case where the overall judgement results are "abnormal", the control unit (DB-CTRL) indicates the 
search unit (DB-SRCH) to search the image to be interpreted from the data storing unit (DB-STRG) to read out "me 
tow doctors' finding data table and overall judgements and the images to be interpreted are written into the optical mag- 
netic disk D corresponding to the examined patient identification information and the name of the examined patient. 
[051 1 ] The optical magnetic disk D is carried to a person to receive the report. 

[0512] At this tim^ a flow of a series of system operations for interpreting tiie chest X-ray image in the lung cancer 
examination is completed. 
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EnrtbodimOTt No. 6-2 

[051 3] Even in this embodiment, as Sections 1,2,3, 5, and 6 of the series of system operations are entirely identical 
to the embodiment no. 6-1 , the description Is omitted, and only a part of 4. Preparation of Interpreting Data will be 
5 desaibed. Then, an example of interpreting a chest X-ray image in the identical lung cancer examination to the embod- 
iment no. 6-1 wfll be hereinafter desaibed. 

4. Preparation of Interpreting Data 

w (1) Detection of abnamality from image by using a different algorithm 

[0514] 

(i) When data are finished registering, the control unit (DB-CTRL) of the database (DB) indicates to search images 

IS registered in the search unit (DB-SRCH) (an image to be interpreted and a previous image) and obtains a 
response. Successively, the following abnormality detecting operations are carried out each image. The abnormal- 
ity to be detected is shadows of the pulmonary nodules and the interstitial lung disease. The abnomiality to be 
detected is the pulmonary nodule shadow and interstitial lung disease. Herein, the algorithms as described in the 
literatures concerning the CAD as described in the column of the prior art are used to detect the abnormality. That 

20 is. the two detecting algorithms of the literatures (1), (4). and (5) are used as to the pulmonary interstitial disease, 
and the two algorithms of the literatures (2), (6), (7), and (8) are selectively used as to the pulmonary nodules. 
(11) The control unit (DB-CTRL) reads out the image data corre-sponding to a sheet of Image from the data storing 
unit (DB-STRG) to send to the Image processing unit (DB-IP). When the image processing unit (DB-IP) receives 
the image data, it operates the pulmonary nodule shadow detecting means by the first algorithm stored inside to 

25 detect presence or absence of the abnormality. The detected results are written into the abnormality data table as 
the first detection results of the pulnfionary nodules. Next, the pulmonary nodule shadow detecting means is oper- 
ated by the second algorithm Id detect presence or absence of the abnormality. The detection results are similarly 
written into the abnormality data table as the second detection results of tiie pulnrK>nary nodules. In the image of 
the examination ID number 920001 , the first detection results were "abnormal", and the second detection results 

30 were "abnormar. 

(iii)The image processing unit (DB-IP), in the same manner as the pulmonary nodules, operates the pulmonary 
interstitial disease detecting means by the first algorithm stored inside, and the interstitial lung disease detecting 
means by the second algorithm, and writes the detected results into the abnormality data table as ttie first and sec- 
ond detection results of the pulmonary interstitial disease. In the images of the examination ID number 920001 . the 
35 first detection results were "nomnal". and the second detection results were "abnormar. 

[051 5] The abnormality data table concerning the image of the examination ID number 920001 is shown in Fig. 96. 
In this connection. Nodule in the figure denotes pulmonary nodules and ILD denotes an interstitial lung disease. 

40 (2) Classif icalion of data according to the detected abnormalities 

[0516] 

(1) The control unit (DB-CTRL) compares respective abnormality detected results of the abnormality data table 
45 each type of the abnormality. The types of the detected abnormalities are the pulmonary nodules and Interstitial 
lung disease. The results detected by using two algorithms each type of the abnormality are classified as follows: 
This is called a first classification. 

Case 1 : The case where both of the first detected results and the second detected results are "normal". 
so Case 2: The case virtiere one d^ected result is "abnormal" and the other detected results are "normal". 

Case 3: The case where both of the first detected results and the second detected results are "abnormal". 



Next, the above-mentioned classified results are compared each type of the abnormality to classify as follows: 
55 This Is called a second classification. 

Case A: The classified results of the type of all abnormalities have been classified in the case 1 . 
Case B: There exists even one of the types of the abnormality classified in the case 3. 
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Case C: This case does not fell under both of the case A and the case B. 

The data falling under the cases A. B, and C are li^ed to register Into lists A. B. and C. 

(ii) As an embodiment of the classification, the classification of the image of the examination ID number 920001 will 
be described. The results of the pulmonary nodules in the abnormality data table as shown in Fig. 96 fait under the 
case 3 In the first classification since both of the first detected results and the second detected results are "abnor- 
mal". Alsa the results of the pulmonary interstitisi disease in the abnormality data table as shewn in Fig. 96 fall 
under the case 2 in the first classification since the first detected results are "abnormal" and the second detected 
results are "normal". Accordingly, the data fail under the case B in the second classification. 

(iii) The classified results of the images of the examination ID numbers 920001 to 920030 are shown in Fig. 97. 
Also, the examination ID numbers in which the second dassffied results fell under the case A, the case B. and the 
case C are respectively registered in the list A. the list B. and the list C. The created list A. list B, and list C are 
shown in Figs. 98. 99. and 100. 

(3) Re-detection of an abnormality from the interpreting image 

[0517] 

(I) When finishing registering the lists, the control unit (DB-CTRL) Indicates the search unit (Db-SRCH) to search 
the image registered In the list C (an Image to be Interpreted and a previous image) to obtain a response. Succes- 
sively, the following abnormality detecting operations are carried out again for each sheet of Image. The detected 
abnormalities are the pulmonary nodule shadows and interstitioal disease. A third algorithm to be used this time is 
is not as narrow in the scope of a normality as In the first algorithm, and the third algorithm is not as narrow in the 
scope of an abnormality as in the second algorithm. The third algorithm Is such that it has a true positive fraction 
to a degree that the doctor can check the overlookedness. and at the same time a false positive fraction becomes 
a minimum. In other words, the third algorithm to be used this time is suitable for a diagnosis of the substantfelly 
same level as the level of the doctor's diagnosis. 

(Ii) A sheet of image data is read out from the data storing unit (DB-STRG) to send to the Image processing unit 
(DB-IP). The image processing unit (DB-IP) receives the image data and operates the pulmonary nodule shadow 
detecting means using the third algorithm stored inside to detect presence or absence of an abnormality and its 
position In the case of the abnormality The detected results are written into the abnormality detailed data table as 
the abnormality detailed detection results of the pulmonary nodules. 

(ili)The image processing unit (DB-IP) operates, in the same manner as the pulmonary nodules, the interstitial lung 
disease detecting means using the third algorithm stored inside and detects presence or absence of the abnormal- 
ity and its position in the case of the abnormality. The detected results are written Into the abnormality detailed data 
table as the abnormality detailed detection results of the interstitial lung disease. 

(Iv) In the case where the abnormality Is detected in any abnormality detecting operations, the CAD processed 
results. 

(v) The control unit (DB-CTRL) associates the examined patient identification information, the name of the exam- 
ined patient, and the abnormality dafe feble corresponding to the examination ID number registered In the list B 
with each other, and Indicates the optical magnetic disk drive (DB-MODD) to write the overall judgement results as 
an "abnormality". Then, the data storing unit (DB-STRG) reads out these data to send to the Image bus (DB-IBUS). 
The optical magnetic disk drive (DB-MODD) receives these data to write Into the optical magnetic disk B. 

(vi) The control unit (DB-CTRL) associates the examined patient identification infonnation and the name of the 
examined patient conresponding to the examination ID number registered In the list A witii each ottier and indicates 
the optical magnetic disk drive (DB-MODD) to write the overall judgement results as a "normality". Then, the data 
storing unit (DB-STRG) reads out tiiese data to send to the image bus (DB-IBUS). The optical magnetic disk drive 
(DB-MODD) receives these data to write into the optical nfiagnetic disk B. 

[0518] The optical magnetic disk B is canied to the patient to be reported to make such a report recommending the 

patient who is reported the overall judgement results "abnormality" to make a dose examination, 

[0519] In the medical group examination, the Interpretation is carried out by two doctors. Accordingly, these two 

sheets of optical magnetic disk C are prepared to carry each of the two workstations (WS). 

[0520] The succeeding operations will be same as the embodiment na 6-1 . 

[0521 ] In this connection, in each of the embodiments, tfie medical examination data and the Identification information 
of the medical examinatton data were stored con-esponding to each other, however tiie medical examination data may 
not have any identification information, or tiie image dafe to output as a doctor's interpretation may be limited to only 
the medical examination dafe. 
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[0522] In each of the embodiments, the image data registered in the list A was written into the optical magnetic disk 
B. however the image data registered in the list A is not written into the optical magnetic disk B. but into the optical mag- 
netic disk D together with the results of the list C interpreted by the doctor. 

[0523] In each of the embodiments, the examined images were classified into three types of list, however the images 
are classified into two types and the list A may be incorporated into the list B without being limited to the above descrip- 
tion, and the images may be classified by the other classifying method and classified into the other number of classifi- 
cation. 

[0S24] In the display method of the comparison results in each of the embodiments, a form of an elliptic set was used, 
however various sets such as a rectangle or the like, various graphics such as a rod. a circle, or the like, and itemization 
can be used without being limited to the above description. 

[0525] A method o1 acquiring a characteristic value of the image in the embodiment no. 5-3 is not Dmited to the method 
desaibed in the embodiments. For example, vartous values are regularized and the regularized value is wdghted to 
add to obtain the sum, which is set as the characteristic value or the fika If the characteristic value expresses the char- 
acteristic of the images, it can be used. 

[0526] Also, in the embodiment of the second invention, the reference time of the CAD processing results was decided 
before the doctor inputs the findings, however the reference time thereof can be decided after the doctor has inputted 
without being limit-ed to the above description. 

[0527] In the embodiments, the business of the medical group examination was explained, however the other inter- 
pretation businesses such as a medical examination in medical institutes or the like can be explained without being lim- 
ited to the above description. 

[0528] In the embodiments, the operations on the digital system were described, however the realizable system is not 
limited to the above descriptk)n. For example, the doctors' interpretation can be made on a film viewer, and the image 
radiographed by a roll film can be digitized. 

[0529] Furthermore, in the embodiments, the operations on the off-line PACS were described, however the operations 
can be carried out even on the on-line PACS without being limited to the above description. 
[0530] In the embodiments, the medical images were described, however this embodiment can be applied to medical 
examinaton data other than the image, that is data having a graphic form such as an electrocardiogram, brain waves, 
or the like, or data arranging a numerk»l value obtained by an automatic chemical analyzer etc. 
[0531] In the embodiments, the medical examination of the lung cancer was described in the example of a chest X- 
ray image, however this embodiment can also be applied to a medical examination or inspection of an organ of a diges- 
tive organ system other than a chest, for example a stomach or the like. 

[0532] As described above, according to the above emlxxjiments of the present Invention, as a doctor can reduce the 
number of sheet of image to be interpreted, an interpretation lime per sheet of image can be prolonged, and it becomes 
possible to interpret with high precision based on much more information. 

[0533] Furthermore, for the examined patient having the extremely high probability of an abnormality, it is possible to 
recommend to make a close examination not through the doctor's interpretation. The period from the time of the med- 
ical examination to the output of the examination results can be made fairly short, and the discovery in the earlier stage 
which is an original object of the medical group examination can be made. 

[0534] It is possible to save useiessness in interpreting the image of the examined patient having the extremely high 
probability of a normality. 

[0535] Furthermore, according to another embodiment when a doctor interprets the images, as the CAD having per- 
formance (diagnostic level) which is suitable and useful for the doctors interpretation is used, it becomes possible to 
diagnose by interpreting with high precision. 

Embodiment No. 7 

[0536] Hereinafter, the seventh embodiment including three modifications (variations) according to the present inven- 
tion will be described. Fig. 108 shows a schematic configuration of a medical picture archiving communicatfon system 
(PACS). 

Embodiment No. 7-1 

[0537] A networt< (NW) 5 is a transmission path for an image communication among respective units and an optical 
fiber is used as a transmission medium in order to make an attempt to communicate at high speed. Herein, a ring-type 
local area network is adopted, of course the other types such as a star-type one or the like may be used. 
[0538] This network 5 is connected with a system manager (SM) 1 . a plurality of types of image acquisition unit (lA) 
2a, 2h a database (DB) 3. and workstations (WS) 4A, 4B, and the respective units can be mutuaUy linked by means of 
a communication protocol. 
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[0539] Furthermore, this network 5 is connected with an exaniination order system 7 through a gateway 6. This exam- 
ination order system 7 is equipped with Inputting means of a keyboard etc. Examination request information for request- 
ing an aquisitlon of images is inputted from the examination order system 7. An example of this examination request 
information is shown in Fig. 120. 

5 [0540] The image acquisition units 2a, 2b are image acquisition units such as an X-ray machine, an ultrasonic diag- 
nostic machine, an X-ray computed tomography machine, a magnetic resonance imaging machine, or the like. These 
image acquisition units 2a. 2b assign an image number to a generated image in the order of its generation, and also 
attach annexed information thereto as peculiar Information concerning the image, and send to the database 3 according 
to an instruction of the system manager 1. An example of this annexed infonrcitlon is shown in Rg. 121. 

10 [0541 ] The system nrtanger 1 1s constituted as shown In Fig. 109. 

[0542] A control bus (SM-CBUS) 1 i is a transmission path between various control information within the system man- 
ager 1 and data. The control bus (SM-CBUS) 1 i is connected with ttie network 5 through a network interface (SM-NWIF) 
1h. The conti-oJ bus 11 is also connected with a control unit (SM-CTRL) 1a. a system disk (SM-SD) lb, an examination 
ID number issuing unit (SM-EIDI) 1c. an examination request information storing unit (SM-EQIM) Id. an examination 

IS history storing unit(SM-EHM) 1e, an Interpretation report storing unit (SM-IDRM) If, and an information search unit 
(SM-SRCH) 1g. 

[0543] The control unit 1 a contains a CPU and system memories, and tiie system manager 1 controls the entire oper- 
ation. The system disk lb. for example a magnetic disk, archives a program for operating in relation to each part of the 
system manager 1 . and supplies this program to the control unit la when an electric power Is turned on. The examina- 

20 tfon ID number issuing unit 1c issues the examination ID number in the order of tiie examination request information 
received from the examination order system 7. The examination request information storing unit Id stores the exami- 
nation request information and tiie examination ID number. The examination history storing unit 1e stores all examina- 
tion histories produced so far by the workstations 4A, 4B. The interpretation report storing unit if stores all interpretation 
reports produced so far by the workstations 4A, 4B. An example of this interpretation report is shown in Fig. 122. 

25 [0544] The information search unit 1g searches various information stored in the examination request information 
storing unit Id, tiie examination history storing unit 1e, or the interpretation report storing unit If in response to search 
demands from the workstations 4A, 4B. 
[0545] The database 3 is constituted as shown in Fig. 1 1 0. 

[0546] A control bus (DB-CBUS) 3i is a transmission path of various control information within the databsse 3 and an 
30 Image bus (DB-IBUS) 3j is a transmission patii of data. The control bus (DB-CBUS) 3i and image bus (DB-IBUS) 3j are 
connected with the network 5 through the network Interf&ce (DB-NWIF) 3h. The control bus 31 and Image bus 3) are also 
connected witii a control unit (DB-CTRL) 3a, a system disk (DB-SD) 3b. an examination directory storing unit (DB-DI R) 
3c, an information search unit (DB-SRCH) 3d, an image storing optical disk unit (DB-IOD) 3e. an image storing mag- 
netic disk unit (DB-IHD) 3f, a block memory (DB-BLKM) 3g, an input unit (DB-INPUT) 3k. and an image input unit (DB- 
35 I INPUT) 3m. 

[0547] The control unit 3a contains the CPU and the system memories and controls the entire operation of the data- 
base 3. The system disk 3b, tor example a magnetic disk, archives a program for operating in relation to each part of 
the system manager 1 and supplies this program to tiie conti'ol unit 3a when an electric power is turned on. The exam- 
ination directory storing unit 3c stores an examination directory as administration information of images stored in the 

40 image storing optical disk unit 3e. One example of this examination directory is shown in Fig. 23. 

[0548] The information search unit 3d searches an examination directory in response to search information from the 
workstation 4A, 4B. The image storing optical disk unit 3e stores an image (containing attached information) acquired 
by tiie image acquisition units 2a, 2b, a representative typical disease example image of various disease examples, and 
overlay data by using an optical disk having a large amount of capacitance as a storing medium. The image storing 

45 magnetic disk unit 3f temporarily stores information which is inputted into or oulputted from tfie image storing optical 
disk unit 3e by using a magnetic disk as a storing medium. A block memory 3g temporarily memorizes an image or 
annexed information by using a semiconductor memory as a storing medium. The input unit 3k. for example a keyboard, 
a touch saeen. is inputting means for inputting various commands or the annexed information. The image Input unit 
3m, tor exanple a cfigitizer for reading a film, reads mainly a typical disease example image. 

so [0549] The workstation 4A is constituted as shown in Rg. 1 1 1 . In this connection, as the workstation 48 has the same 
configuration as the workstation 4A, the description is omitted. 

[0550] A control bus (WS-CBUS) 4k is a transmission patti of various conti-ol information within the workstation 4A 
and an Image bus (WS-IBUS) 41 is a transmission patti of data. The control bus (WS-CBUS) 4k and Image bus (WS- 
IBUS) 41 are connected witti the network 5 through a network interface (WS-NWIF) 4j. The control bus 4k and image 
55 bus 41 are also connected wHh a control unit (WS-CTRL) 4a, a system disk (WS-SD) 4b, an input unit (WS-INPUT) 4c. 
a character display unit (WS-CDISP) 4d, a CAD processing unit (WS-CADP) 4e, an image storing unit (WS-IM) 4f. ari 
imaging frame memory (WS-IFM) 4g. an image display manager (WS-IDM) 4h, an information search unit (WS-SRCH) 
4m. a reference priority order information making unit (WS-MKP) 4n, and an examination history making unit (WS- 



Patent provided by Sughrue Mron, PLLC - http://www.sughrue.com 



EP0973116A1 



MKH) 4p. Furthermore, herein the plurality of image display managers are connected with four Image display units (WS- 
IDISP) 4i. 

[0551] The control unit 4a contains the CPU. system memories, or the like, and controls the entire operation of the 
workstation. The system disk 4b archives a program relating to assodated operations of each part of the workstation 

5 4A. abnomiality detecting means selecting informatfon, and various reference otder rules by using a magnetic disk as 
a storing medium. The reference order rules are the rules for deciding a priority order to refer to previous irmges or typ- 
ical disease example Images. This program is sent to the control unit 4a when an electric power is turned on. Rg. 40 
as described below shows the abnormality detecting means selecting information, and Figs. 123 to 128 show one 
exarrpie of various reference order rules. 

10 [0552] The input unit 3c. fa example a keyboard, a touch screen. Is inputting means tor iriputting various commands 
or interpretation reports. The character display uniy 4d, for exarnple a CTR (Cathode Ray Tut)e) display or a liquid crys- 
tal panel display, displays mainly character Information such as examination request information, examination histories, 
an interpretation report, or the like. 

[0553] The CAD processing unit 4e is equipped with a Computer-Aided Diagnosis (CAD) function to detect various 
IS abnormalities of an uninterpreted Image to create an abnormality data table. An example of tiiis abnormality data table 
is shown in Rg. 129. 

[0554] This CAD processing unit 4e contains a plurality of types of abnonnality detecting means. The abnomiality 
detecting means has (a) means for detecting shadows of an interstitial lung disease in a frontal image of a chest plain 
X-ray image: (b) means for detecting shadows of pulmonary nodules in a frontal image of a chest plain X-ray image; 

20 and (c) means for detecting shadows of a fine calcification of a breast in a breast X-ray Image. Furthermore, tills CAD 
processing unit 4e contains dissecting division recognizing means. This dissecting division recognizing means recog- 
nizes to which dissecting divisfon an abnormality detected by tiie abnormality detecting means belongs In internal 
organs to be examined. The dissecting division is. for example In lungs, each region which is trisected vertically In each 
of two right and left lungs, and the regions are respectively called an "upper left lung field", a "middle left lung fieW", a 

25 "lower left lung f ieW. an "upper right lung field", a "middle right lung field", and a "lower right lung field". 

[0555] This specifying means has venous ones, and a technique adopted herein has been disclosed in Japanese Pat- 
ent Application Laki-Open No. 1 -125675. In this connection, the dissecting division of tiie lungs shouU precisely be sec- 
tioned based on tiie position relationship with a tip of a rib, however as it is difficult to recognize tfie tip of rto by a 
computer, in the above-mentioned technique, generally by using a fact that a lower edge of the collarbone exists in a 

30 center position of the upper lung field and that an upper edge of ttie diaphragm coincides with a lower edge of ttie lung 
field, based on the position relationship of the lower edge of the collarbone with the upper edge of the diaphragm as it 
is easy to comparatively recognize tfiem from an Image, It is possible to recognize a scope of each division on ttie 
image. If the center position of tiie abnormality is checked up witti tiie coordinates on the image which specify each 
region, it is possible to specify the dissecting division relating to tfie position of the abnormality. 

35 [0556] This CAD processing unit 4c outputs judgement results of the abnormality detecting means or a region con- 
taining an abnormality into an abnormality data table in a lump. 

[0557] The image storing unit 4f temporarily stores examination request Information to be treated during operations 
of the workstation, examination histories, an interpretation report, an uninterpreted image, a typical disease example 
image, annexed information, overlay display informatfon, an abnormality data table, and reference priority order intor- 

40 matlon by using a magnetic disk as a storing medium. The reference priority order Information is a previous image 
decided by the reference priority order infomiatlon making unit 4n based on the image reference preparation rules or 
priority order Information to be referred to in tiie typical disease example image. The imaging frame memory 4g tempo- 
rarily memorizes an image by using a semfoonductor memory as a storing medium. 
[0558] The image display manager 4h is constituted as shown in Rg. 21 . 

45 [0559] The Image bus 41 is connected with an overlay portion 44 through an image memory 42. The cortrol bus 4k is 
also connected witii the overlay portion 44 through a control portion 40, an overtay data making portion 41 , and an over- 
lay memory 43. in order. Furthermore, the overiay portion 44 is connected witfi ttie image display 4i through a displaying 
memory 45 and a D/A converter 46. in order. 

[0560] An uninterpreted image, a prevfous image, and a typical disease ^cample Image are inputted from the image 
so bus 41 to be sent to ttie overlay portion 44 ttirough the image memory 42. Furfliermore. overlay display Information con- 
cerning such uninterpreted image is inputted from the control bus 4k to send to the overlay data making portion 41 
through ttie control portion 40 to produce overlay data (images showing an abnormality). This overlay data are sent to 
the overlay portion 44 ttirough an overlay memory 43a. The overlay portion 44 synthesizes ttie uninterpreted image witti 
the overlay data to produce a synthesized image, which is displayed on the image display unit 41 ttirough any of ttie dis- 
55 playing memory 45 and D/A converter 46. Furttiermore. ttie previous Images or typical disease exanpte image are 
respectively sent to ttie ottier displaying memory 45 ttirough ttie overiay portion 44 and displayed on ttie image display 
unit 4i ttirough the D/A converter 46. 

[0S61] Refen-ing back to Fig. 1 1 1. ttie information search unit 4m searches various information stored in the image 
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storing unit 4f ba&ed on the search information inputted from the input unit 4b. The examination history making unit 4p 
adds examination information concerning the uninterpreted image which is sent to the workstaion 4A to the previous 
examination histories which do not contain the examination intomiation of such uninterpreted image to renew these 
examination histories. In this connection, the examination information is selected from the examination request informa- 
5 tion and annexed information to cbtain the necessary information. An example of the examination histories is shown in 
Fig. 130. 

[0562] The reference priority order information making unit 4n decides a priority order of the previous image and typ- 
ical disease example image to be referred to wrtien interpreting such uninterpreted image based on various image ref- 
erence rules, and makes refernce priority order information according to the decided contents. The reference rules 

10 contain the image reference rules in the case where an abnormality was detected in the CAD processing results in the 
prevfous examinations of the same patient as such uninterpreted image, and the image reference rules in the case 
where an abnormality was not detected in the CAD processing results in the prevfous examinations of the same patient 
as such uninterpreted image, and the image reference rules concerning the typical disease example image. 
[0563] Next, operations of this en^3odiment having such configuration will be descrbed. 

IS [0564] At installing, a plurality of types of typical disease exampfo image have beforehand been inputted from the 
image input unit 3m of the database 3 and stored in the image storing optical disk 3e through the image storing mag- 
netic disk 3f, Furthermore, various annexed information of the plurality of types of typical disease exanple image is 
inputted from the input unit 3k of the database 3. and stored in the image storing optical disk 3e through the image stor- 
ing magnetic disk 31 An embodiment of this annexed information is shown in Fig. 1 31 . 

20 [0565] Next, a flow from a generation of an image from an examination request to its archive in the image storing opti- 
cal disk 3e will be explained. 

[0566] First, the examination request information is inputted through the examination order system 7 to make an 
examination request. An embodiment of this examination request information is shown in Fig. 132. 
[0567] The examination request information consists of individual information concerning a patient, and examination 
25 information indicating an examination portion, an examination procedure, or the like which Is necessary for the radiog- 
raphy, and clinical Information of a patient, and a disclosed disease name. In this connection, as the clinical information 
of a patient is inputted only when a judgement diagnosis has already been established at requesting such examination, 
there are some cases where any infamation does not exist when occasfon demands. 

[0568] This examination request information is sent to the system manager 1 through the network 5. and fransferred 

30 from the system manager 1 to the appropriate image acquisition unit 2a. The radiography is performed by a radiogra- 
pher according to an instruction of the examination request information and an image is produced in the image acqui- 
sition unit 2a. The annexed information is attached to this image to send to the database 3 through the network 5 to be 
stored In the image storing optical disk 3e thiough the image storing magnetic disk 3f. An embodiment of this annexed 
information is shown in Fig. 133. 

35 [0569] Furthermore, by an instruction of the system manager 1 , this image and tine annexed informatfon are sent 
together with the examination request Information to the worstation 4A through tiie network 5 and stored In the image 
storing unit 4f. The examination history making unit 4q adds the examination histories of such patient which are stored 
in the image storing unit 4f to information extracted from the annexed information of such examination and the exami- 
nation request information to renew these examination histories. An embodiment of these renewed examinatfon histo- 

40 ries is shown in Fig. 134. 

[0570] These renewed examination histories are returned to the image storing unit 4f and stored therein. 
[0571 ] Furthermore, such uninterpreted image Is sent from the image storing unit 4f to the CAD processing unit 4e to 
execute tiie CAD processing. The CAD processing unit 4e is provided, as described above, with three types of means 
comprising (a) means for detecting shadows of an interstitial lung disease in a frontal image of a chest plain X-ray 

45 image: and da) means for detecting shadows of pulmonary nodules in a frontal image of a chest plain X-ray Image; and 
(c) means for detecting shadows of fine calcification of a breast in a breast X-ray Image. The CAD processing unit 4e 
spedfies a detectable type of an abnormality concerning this image by using abnormality detecting means selecting 
information and the abnormality detecting means according to these results. Herein, as an examination portion is a 
chest and a procedure of an examination is a plain radlodraphy and an imaging direction is P A. the abnormality 

so detecting means capable of detecting an interstitial lung disease and the abnormalrty delecting means capable of 
detecting pulmonary nodules are selected. By the selected abnormality detecting means, an abnormality detection 
processing executes concerning an original Image and it Is possiljle to judge presence or absence of an abnormality, a 
type of an abnormality (to be detected at a time when the abnormality detecting means is selected), a position of an 
abnormality, a degree of an abnormality, and a region containing an abnormality of a dissecting division. These judge- 

55 ment results are sent to the Image storing unit 4f and added to the abnormality data table. Thus, the abnomiality data 
table is renewed and an embodiment of the renewed abnormality data table Is shown in Fig. 135. 
[0572] The information added newly in this abnormality data table is information of reference nun*ers 1 and 2. 
[0573] After the processing described in Fig. 135. an interpreting doctor inputs an insfruction of an interpretation start 



Patent provided by Sughrue Mioa PLLC - http://www.sughrue.com 



EP 0 973 116 A1 



from the input unit 4c of the workstaion 4. According to this, the oldest uninterpreted image is decided as an initial image 
to be interpreted. This initial image to be Interpreted wBI be explained as the uninterpreted image of the examination ID 
number: 108801 as described above. 

[0574] Such uninterpreted image is sent to the image display manager 4h from the image storing unit 4f and cfisplayed 
on any image display unit 4i. 

[0575] At this time, by the reference priority order information making unit 4n. the reference priority order information 
is made. The processing for making this reference priority order information will be explained below. 
[0576] First of ail. the abnormality data table and such uninterpreted image and the examination histories concerning 
the identical patient are sent from the image storing unit 4f to the reference priority order Infomtation making unit 4n. 
Then, ail the examination ID numbers of these examination htetories are extracted. It Is judged as to whether or not at 
least one examination ID number exl^s In the abnormality data table. In the case where the examination ID number 
exists in the abnomiality data table, this means that the abnormality has been discovered by the CAD processing In the 
examination of such examination ID number. 

[0577] As the results of this judgement, when at least one e^tmination ID number exists In the abnormality data table, 
the following processings 1 to 4 and processing 6 are sequentially executed, and when any examination ID number 
does not exist, the processings 5 and 6 are sequentially exercised. 

Processing 1 

[0578] In the processing 1. a priority order Is decided by using the image reference rules as shown in Fig. 123. For 
this reason, these Image reference rules are sent from the image storing unit 4f to the reference priority order informa- 
tion making unit 4n. Also, the abnormality data table and examination histories are sent from the image storing unit 4f 
to the reference priority order information making unit 4n. 

[0579] Then, by using the abnormality data table and examination histories, the examination portion, the modality, the 
type of an abnormality, the position of an abnormality of such uninterpreted image are extracted. Similarly, the exami- 
nation portion, the modality, the type of an abnormality, and the position of an abnormality as to each previous exami- 
nation are extracted, and tiie identification with the examination portion of such uninterpreted image etc. is judged. As 
the results of this judgement, the previous examination identical to such uninterpreted image in the examination portion 
etc. Is selected. 

[0580] As to each of the selected previous examination, it Is judged by using the examination histories as to whether 
or not the clinical Information exists. When characteristic items such as a dose of medicines, an appearance in a 
change of the condition of a disease, or the like generate in the stage of each examination, a responsible doctor Inputs 
the clinical information into the examination information as his/her comments, and most of the examinations having this 
clinical information is generally very material In the interpretation. 

(0581 J As the results of this judgement, all the exantinations having the clinical information are an object to decide a 
prtority order of this processing 1 . As to all the examinations, the priority order is decided based on contents of the clin- 
ical infonnation and a date of the examination. First of all, as shown in the image reference rules (a) as shown in the 
table, an examination acquiring the first priority order is one having the clinical Information of contents that "a change 
in the condition of a disease appears". Then, as shown in the image reference rules (b) as shown In the table, the exam- 
ination having the clinical information which does not have these contents acquires a higher priority order which is next 
to the first priority order from an examination having the later date of the examination. The thus-obtained priority order 
information Is written into the reference prtority order Information. 

[0582] Here, a description will be made with reference to an embodiment, and as at least any examination having the 
clinical information does not exist in the examination histories of Fig. 1 34, in such processing 1 , any examination acquir- 
ing the priority order does not exist. 

Processing 2 

[0583] In the processing 2, a priority order Is decided by using the image reference rules as shown In Fig. 124. For 
this reason, these image reference rules are sent from the image storing unit 4f to the reference priority Ofder informa- 
tion making unit 4n. Also, the abnormality data table and examination histories are sent from the image storing unit 4f 
to the reference priority order infamation making unit 4n. In the processing 2. presence or absence of the clinical infor- 
mation is not a factor of dedding the prtority order unlike the processing 1. In the processing 2, all previous examina- 
tions having the identical examinatton portion, modality, type of an abnormality, position of an abnormality to such 
uninterpreted images are an object of the priority order. All examinations satisfying this identif Icatton acquire a priority 
order based on the relationship with the sequential date of the examination. In short, as shown in the image reference 
rules (a) and (b) as shown in Fig. 124, the oldest namely most previous examination acquires a first priority order in 
such processing 2. The older the other examinations are, the higher priority order they acquire next to the f iret priority 
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order. The thus-obtained priority order in the processing 2 is allocated lower than the priority order of the processing 1 
and written into the reference priority order information. 

[0584] Mae specifically, the examination having the examination ID number: 100902 in the examination histories of 
Fig. 134 is adapted for the image reference rules (a) as shown in Fig. 124, and the examination having the examination 
5 ID number: 103541 Is adapted for the image reference rules (b) as shown in Rg. 124. Accordingly, as any examination 
is not adapted for the image reference rules in the processing 1, each of the above-mentioned examinations adapted 
for the image reference rules (a), (b) of Rg. 124 in such processing 2 is written into the first and second priority ortieis 
of the reference priority order information, as shown in Fig. 136. 

10 Processing 3 

[0585] In the processing 3, a priority order is decided by using the image reference rules as shown in Rg. 125. For 
this reason, these image reference rules are sent from the image storing unit 4f to the reference priority order informa- 
tion making unit 4n. Furthermore, the abnonrality data table and the examination histories are sent from the image stor- 
es Ing unit 4f to the reference priority order information making unit 4n. In the processing 3. the previous examination 
having the identical examination portion to the uninterpreted image is an object of a priority order. The priority order in 
the objective examinations is decided based on the date of an examination and the type of a modality as shown in the 
image reference rules (a) to (c) as shown in the table Here, the latest examination in the examinations by an X-ray tom- 
ography machine acquires a first priority order in the processing 3. Subsequently to this examination, the latest exami- 
ne nation in the examination by an X-ray computed tomography machine (CT) and the latest examination in the 
examination by a magnetic resonance imaging machine (MR) acquire higher priority orders sequentially. The thus- 
obtained priority order In the processing 3 is allocated lower than the priority order of the processing 2, and written into 
the reference priority order information. 

[0586] More specifically, as any examination which is adapted for the image refernce rules as shown in Fig. 1 25 does 
25 not exist in the examination histories of such patient, any examination which is written Into the reference priority order 
information does not exist in the processing 3. 

Processing 4 

30 [0587] In the processing 4. a priority order is decided by using the image reference rules as shown in Rg. 126. For 
this reason, these image reference rules are sent from the image storing unit 4f to the reference priority order infbrma- 
tion making unit 4n. Furthermore, the abnormality data table and the examination histories are sent firom the image stor- 
ing unit 4f to the reference priority order information making unit 4n. In the processing 4, the previous examination 
having the identical examination portion to tfie uninterpreted image is an object of a priority order. The priority order in 

35 the objective examinations Is decided based on the relationship with the type of an abnormality of an uninterpreted 
image and the sequential date of an examination as shown in the image reference rules (a) to (f) as shown in Rg. 126. 
Furthernrore. the different modality has beforehand been decided each type of an abnormality of the uninterpreted 
image. Accordingly, in the processing 4. the type of an abnormality of the uninterpreted image is specified from the 
abnormality data table, and the latest examination of tfie examinations using tiie modality corresponding to the type of 

40 this abnormality is selected. The tiius-obtained priority order in the processing 4 Is allotted lower than the prtority order 
in the processing 3 and written into the reference priority order Information. 

[0588] More specifically, as any examination which is adapted for the image reference oiles as shown in Rg. 126 does 
not exist in ttie examination histories of such patient, any examination whk;h is written into the reference priority order 
information does not exist in the processing 3. 

45 

Processing 5 

[0589] As described above, in the processing 5, the abnormality data table does not have any examination ID number 
of the examination histories of such patient In other words, when any abnormalities have not been discovered by the 

so CAD processing even in any previous examination of such patient, a priority order is immediately decided without exe- 
cuting the above-mentioned processings 1 to 4. Namely, in the processing 5. the priority order is decided by using tiie 
image reference rules as shown in Rg. 127. For this reason, tiiese image reference rules are sent from the Image stor- 
ing unit 4f to the reference priority order information making unit 4n. Furthermore, the previous examination request 
information of such patient and the examination histories of such patient are sent from tfie image storing unit 4f to the 

55 reference priority order information making unit 4n. In the processing 5, all examinations of such patient are an object 
of ttie priority order. As for tiie priority order in tiiese objective examinations, as shown in the image reference rules (a) 
to (h) as shown In Fig. 127, the previous examination for the identical examination portion to ttie uninterpreted image is 
prior to tiie previous examination for ttie different examination portion from ttie uninterpreted image. Furttiermae. ttie 
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previous examination by the identical modality to the uninterpreted image is prior to the previous examination by the dif- 
ferent modality. Furthenmore. the examination having the later date of an examination is prior to that having the older 
date of an examination. According to these rules, the prior order in the processing 5 is decided. The prior order in the 
processing 5 which is obtained according to these three types of rule is written into the reference priority order infbrma- 
5 tion as a first priority order in the same manner as 

10590] the processing 1 . More spedf tcaOy, as the examination ID number having at least one examination history of 
such patient exists in the abnornfiality data table, the priority order Is not decided. 

Processing 6 

w 

[0591] The processing 6 is a processing for setting a priority order concerning a typical disease example image and 
is regularly executed following the processing 4 or 5. In the processing 6. a priority order is decided by using the image 
reference rules as shown in Fig. 1 28. For this reason, the abnormality data table and the examination request Informa- 
tion of such uninterpreted image are sent from the image storing unit 4f to the rderence priority order information mak- 
16 ing unit 4n. In the processing 6. it is first judged as to whether or not the examination ID number of such uninterpreted 
image exists, that is whether or not an abnormality is discovered in such uninterpreted image by the CAD processing. 
Herein, when an abnormnality Is not discovered In such uninterpreted image by the CAD processing, at the time this 
processing 6 is completed. 

[0592] On the other hand, when the examination ID number of such uninterpreted image exists in the abnormality 

20 data table, a priority order is decided according to the typical disease example Image reference rules as shown in the 
table as to a plurality of types of typical disease example imaga This deciding processing is carried out as follows: First 
of all. in a typical disease example image search unit 4q, when the CAD processing results of the uninterpreted image 
is a cancer and its size Is 1 cm or more accoitJing to the typical disease example image reference rules (a), a first priority 
order is set in the processing 6 for the typical disease example image which has the Identical examination portion and 

25 modality to the uninterpreted image and which is further made a benign judgement. An embodiment of the plurality of 
typical disease example image to which this first priority order is set is shown in Rg. 1 12. Subsequently to this first pri- 
ority order, according to the typical disease example image reference rules (b), (c). the typical disease example image 
having the identical type of an abnormality to the uninterpreted image is an object to which a priority order is given. An 
embodiment of the annexed information of the typical disease example Image having the identical type of an abnormal- 

30 ity (interstitial lung disease) to this uninterpreted image is shown In Figs. 137A. 137B. 

[0593] Here, there are two types of the disease example 5 and the disease example 1 0. A second priority order in the 
processing 6 is set to the typical disease example Image (cfisease example 5) having the identical position of an abnor- 
mality to the uninterpreted image herein, and a third priority order in the processing 6 Is set to the typical disease exam- 
ple image (disease example 10) having the different position of an abnormality from the uninterpreted image. The thus- 

35 obtained priority order in the processing 6 is sent to the reference priority order information making unit 4n and allocated 
lower than the priority order In the processing 4 or the processing 5, and is written into the reference priority order infor- 
mation. In this connection, when the typical disease example Image In the processing 6 Is written Into the reference pri- 
ority order information, a tag of a "disease example" showing the typical disease example image is added thereto. An 
embodiment of the thus-aeated reference priority order infbmiation is shown in Rg. 138. 

40 [0594] This reference priority order information is sent to the Information search unit 4m. A calling demand of a refer- 
ence Image of the examination ID included in this reference priority order information Is sent from the Information 
search unit 4m to the database 3. In response to this calling demand, a plurality of sheets of reference image of such 
examination ID is sent from the database 3 to the Image staing unit 4n and stored. In this connection, the image storing 
unit 4n has a small amount of storing capacitance, so that, as described above, only six sheets of Image cannot be 

45 stored. The uninterpreted images consist of a set of two sheets and the Images included In each of the examination ID 
nunf*ers having the prior orders 1. 2 consist of two sheets, respectively Therefore, the total four sheets of reference 
Image included in each of the examination ID numbers having the priority orders 1 . 2 are sent initially to the image stor- 
ing unit 4n. and stored therein. The remaining Images of the examination ID are transfen'ed from the image storing opti- 
cal disk unit 3e of the database 3 to the image storing magnetic disk unit 3f so that the remaining images may promptly 

so cope with a calling demand from the workstation 4. 

[0595] When an instruction of the effect of displaying the previous image is Inputted from the input unit 4c. according 
to the reference priority order information, the previous image to which a disease example tag is not attached is sent 
from the image storing unit 4n to the Image display manager 4h from the higher priority order sequentially, and is dis- 
played on the image display unit 4i other than the image display unit 4i displaying the uninterpreted Image. At this 

55 Image, con-esponding to the number of the image display unit 4i, a pluraOty of sheets of reference image may be sent 
to the image display manager 4h and displayed on the separate image dispaly unit 4i. When an instruction of the effect 
of displaying the previous Image is inputted once mae from the input unit 4c. corresponding to the reference priority 
order information, the previous image having a lower priority order than the image displayed presently is sent from the 
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image storing unit 4n to the image display manager 4h to dispaly on the image display unit 4i. Thus, Ijy repeatedly input- 
ting an instruction of the effect of displaying the previous image, a plurality of sheets of previous image are exchanged 
and displayed according to the priority order of the reference priority order information. 

[0596] Additionally, when an instruction of the effect of displaying the typical disease example image from the input 
5 unit 4c, corresponding to the reference priority order information, the typical disease example image to vifhich a disease 
exanfple tag is attached is sent from the image storing unit 4n to the image display manager 4h from the higher priority 
order sequentially, and displayed on the infiage display unit 4i other than the image display unit 4i displaying the unin- 
terpreted Image. An instruction of the effect of displaying the typical disease example Image is inputted once more to 
exchange and display the typical disease example image having the lower priority order. 
10 [0597] A doctor interprets with reference to this reference image and creates an interpretation report. This Interpre- 
tation report is archived in the image storing unit 4f to complete such interpretation. 

[0598] As described above, according to this embodiment, as the priority order of the reference Image is decided 
based on the CAD processing results, an interpreting doctor is not required to select the reference image from the list 
and can also refer to a reference image even if he/she cannot judge a type of an abnormality of the uninterpreted image. 
IS Also, as the reference image is transfen'ed in the sequential order of the priority order from the database to the work- 
station to be stored therein, the reference image indicated by the Interpreting doctor is not stored in the workstation 
unlike the prior art, therefore a frequency of calling directly from the workstation to the database reduces and accord- 
ingly interpreting work can be progressed with efficiency. 

[0599] In this embodiment, there are provided four image display units in the above description, and this embodiment 
20 is not limited to this and the number of image display unit can be more or less than four units. Also, generally, as for an 
arrangement of a plurality of concun-ent display images, a side picture is disposed in the lateral side of a frontal picture, 
however It can be displayed with the other arrangement. Furthermore, the finding Information is treated as an Interpre- 
tation report in the above desaiption, however the other information containing findings other than the interpretation 
report can also be treated. The decision of the priority order according to the reference rules was explained In the above 
25 description, however if these mies reflect the CAD processing results, the priority order can be decided according to the 
other reference rules. Furthermore, the typical disease example image can selectively be displayed according to the 
indication of the interpreting doctor without setting the priority order, too. 

Embodiment No. 7-2 

30 

[0600] Next, a second embodiment will be described. 

[0601 ] This embodiment relates to an image acquisition unit of Fig. 1 08 in the first embodiment. An embodied config- 
uration of this image acquisition unit is shown in Fig. 1 1 3. The description of the other parts which are identical to Rgs 
109, 110. 111 and 21 is omitted. 
35 [0602] In Fig. 113, reference numeral 2A is a control bus which is a transmission path of various control signals, and 
reference numeral 2B is an image bus which is a transmission path of an Image data. The control bus 2A and the image 
bus 2B are connected with a control unit 2C. a system disk 2D. an X-ray generator 2E, an X-ray machine 2F. an image 
storing unit 2G. a CAD processing unit 2H, a next examination condition deciding unit 21, an input unit 2J, and a display 
unlt2K. 

40 [0603] The control unit 2C contains a system memory such as a CPU. a semiconductor memory, or the like, and con- 
trols operations of the entire image acquisition unit. The system disk 2D stores a basic program required to control oper- 
ations of the entire image aquisition unit, and supplies the basic program to the control unit 2C when an electric power 
is turned on. The X-ray generator 2E contains a high voltage electric power and applies a high electric voltage to the X- 
ray machine 2F according to an Instruction of the control unit 2C. The X-ray machine 2F contains an X-ray tube, an 

45 image Intensifier, a TV camera, an analog/digital converter and the like, and is a unit for radiographing an X-ray image 
of a person to be examined and for outputting it as digital signals. The image storing unit 2G stores temporarily digital 
image data outputted from the X-ray machine 2F by using, for example, a semiconductor memory or a magnetic disk 
as a storing medium. The CAD processing unit 2H is idetical to the CAD processing unit as shown in Rg. 1 1 1 of the 
above first embodiment, and executes the CAD processing as to the digital image outputted from the X-ray machine 2F. 

so and outputs the abnormality data table. The next examination condition deciding unit 21 decides necessity of an addi- 
tional examinatton by using the abnormality data table of the CAD processing unit 2H. and also sets examination con- 
ditions (imaging conditions) of the additional examination when the additional examination is required. The input unit 2J 
Is a keyboard, a mouse, or a touch screen, and is used for inputting commands of a radiographer or various information. 
The display unit 2K is a CTR display or a liquid crystal panel, and displays an image or various character information. 

55 [0604] Next, operations of the image acquisition unit having such configuration will be explained. 

[0605] The examination request information is sent to the X-ray machine 2R A radiology technologist starts, for exam- 
ple, a chest plain X-ray imaging according to the examination request information. The following advance preparations 
are made before this examination start. First, the imaging conditions such as a tube current, a tube voltage, an exposing 
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time Interval, or the like are set from the input unit 2J. These imaging conditions are judged by a radiographer based on 
a physical characteristic of a person to be examined such as his/her age. sex. thickness, or the like. The imaging con- 
ditions are set at, for exanple, the tube current 200mA. the tube voHage 80kV, the exposing time interval 0. 1 sec. Also, 
according to an examination portten or an examination direction of the examination request information, the imaging 
conditions are set so that the person to be examined for the X-ray tube or the Intensifler of the X-ray machine 2F may 
be exposed to X-rays from his/her back side while he/she keeps the postura 

[0S06] When the abovenmentioned advance preparations are conpleted. X-rays are exposed actually and an imaging 
Is carried out. The thus-obtained image data are outputted as digital image data through the analog/digital converter. 
[0607] These image data are immediately sent to the CAD processing unit 2H, and CAD-processed therein. As the 
results of this CAD processing, the abnormality data table is outputted from the CAD processing unit 2H. This abnor- 
mality data table contains each information such as presence or absence of an abnormality, a type of an abnormality, 
a position of an abnormality (region having an abnormality), and a progress degree of an abnormality as described also 
in the first embodiment. 

[0€08] This abnormality data table is sent to the next examination concfition deciding unit 21. The next examination 
condition decfeion unit 21 judges necessity of an additional examination, and also decides examination conditions of the 
additional examination (imaging conditions) when the additional examination is required. The procedures will be 
desaibed. Fig. 114 is a flowchart showing the procedures of judgments of necessity of the additional examination by 
the next examination condition deciding uret 21 and decisions of the examination conditions of the additional examina- 
tion (imaging conditions) when the additional examination is required, and Fig. 1 15 is a detailed ftowchart of block A of 
Fig. 1 14, and Rg. 1 16 Is a detailed flowchart of Wock B of Fig. 114. 

[0609] As shown In Rg. 1 1 4, the next examination condition deciding unit 21 judges as to whther or nor an abnormality 
is detected by tfie CAD processing unit 2H (Si ). This judgement is made on the basis of whettier or not such examina- 
tion ID exists in tiie abnormality data table. If such examination ID exists In the abnormality data table, an abnormality 
Is indicated to detect by the CAD processing unit 2H, and rt such examinatbn ID does not exist in the abnormality data 
table, an abnormality is indicated not to delect by the CAD processing unit 2H. When No in S1 . namely an abnormality 
is not detected in such acquired image, proceed to S4. and it Is judged that the next examination (additional examina- 
tion) is unnecessary. According to this judgement, a message "No next examination" Is displayed in the display unit 2K. 
When Yes in SI , namely an abnomiality is detected in such acquired image, proceed to a judgement step of S2. In S2. 
it is judged as to whether or not a type of such abnormality is a specified type, herein an interstitial lung disease. Here, 
if it is the interstitial lung disease, proceed to a contactor A. and if it Is not the interstitial lung disease, proceed to a 
judgement step of S3. In S3, it Is judged as to whether or not a type of such abnormality is the other specified type, 
herein pulmonary nodules. Here, if it is the pulmonary nodules, proceed to a contactor B, and if it is not the pulmonary 
nodules, proceed to S4, and it Is judged that the next examineiion (additional examination) is unnecessary According 
to tills judgement, a message "No next examination" is displayed in the display unit 2K. 

[061 0] Rg. 1 15 is a flowchart showing processing procedures following ttie contactor A of Rg. 1 14. Here, first a judge- 
ment step of S8 is executed. In the judgement step of 88. it Is judged as to whether or not a degree of such abnormality 
(herein an interstitial lung disease) is Included witiiin a predetermined scope. Here, when the degree of such abnormal- 
ity is Included within a predetermined scope, proceed to S9, and it is judged that the next examination (additfonal exam- 
ination) is unnecessary According to this judgement, as shown in Fig. 1 1 7. the type of an abnormality "Interstitial Lung 
Disease * detected in tiie display unit 2K and the message "No next examination" are displayed. On the other hand, 
when a degree of such abnormality is included in a predetermined scope in S9. it is judged that the additional exami- 
nation is necessary, and proceed to a selection routine of examination conditions of the additional examination. This 
predetermined scope Is here set at scopes 5 to 7. The scope of ttie detectable degree of an abnonnality in ttie CAD 
processing is 1 to 10 (1 : the lightest degree. 1 0: the weightiest degree). It is judged that the degree of such abnormality 
is included In this predetermined scope and that the next examinatfon (additional examination) is unnecessary, and a 
basis of ttie judgement is as follows: In short, these are some possibilities that an element of an erroneous detection is 
included in the CAD processing when detecting ttie degree of an abnonnality of 4 or less, and as, even if ttie additional 
examination is carried out. there are high possibilities ttiat the erroneous detection generates again. It is judged that tfie 
additional examination is unnecessary Furttiermore. as an interpreting doctor can confirm that tfie abnormality having 
the degree of an abnormality of 8 or more exists definitely in ttie interpreting worK it is judged ttiat ttie additional exam- 
ination is unnecessary. Accordingly, it is flexible ttwt ttie degree of an abnormality is included in this predetermined 
scope as an indefinite element such as an erroneous detection or ttie like may be interposed in the course of ttie judge- 
ment off presence or absence off the abnormality, and ffurttiermore ttie interpreting doctor cannot always confirm defi- 
nitely ttie existence of ttie abnormality In the interpreting work, and if ttie examination conditions are altered to 
reexamine, higher interests can be obtained. When Yes in SB. namely tfie degree of such abnormality is included in ttie 
predetermined scope, proceed to ttie judgement step of Si 1 . In Si 1 . It is judged as to whether or not a position of an 
abnormality is a specified position. This specified position is herein a right lung f ieW. When Yes in S1 1 . namely ttie posi- 
tion of the abnormality is not in a right lung field, but In a left lung field. S12 is executed and ttie Imaging cfirection in ttie 
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examination conditions of the additional examination is set at R -> L which is suitable for the imaging of the left lung 
field. Furthermore, when No In S1 1 , namely the position of the abnonnallty is in the right lung field, Si 3 is executed and 
the imaging direction in the examination conditions of the additional examination is set at L R which is suitatsle for the 
imaging of the right lung field. When the imaging direction in the examination conditions of the additional examination 

5 in 812 or 813. proceed to a judgement step of 814. In 814, It is judged as to whether or not a tube voltage of such 
examination is a predetennined value, herein l20kV. There are some possa)illties that a contrast of an image Is reduced 
due to a high tube voltage, as this result, an erroneousness In the degree of the abnormality by the CAD processing 
generates, and it is avoided by the additional examination based on this judgement. Accordingly, when No in Si 4, the 
examination condtions of the additional examination are set at a slightly lower value than a tube voltage of such exam- 

70 ination, for example, a tube voltage of 90kV Corresponding to this tube voltage, the tube cunent is set at, for ecanple, 
200mA, and an exposing time is set at for example, 0.2 sec. On the other hand, when Yes in S14, similarly the exami- 
nation conditions of the additional examination are set at a slightly lower value than the tube voltage of such examina- 
tion, for example, the tube voltage of 1 15kV. Corresponding to this tube voltage, the tube current is set at. for exanple, 
200nriA, and the exposing time is set at, for example, 0.15 sec. The selection routine of the examination conditions of 

IS the additional examination is repeatedly executed as to all interstitial lung diseases. The ttius-oMained examination 
conditions of the additional examination Is displayed on the display unit 4K together with ttie message "Next examina- 
tion' as shown in Rg. 1 18. and the additional examination under tiiese examination conditions is called forth. 
[061 1 ] When No in 82, 83 is executed. In 83. it is judged as to whetiier or not ttie type of an abnormality is a specified 
type, herein pulmonary nodules. When Yes in S3, namely tiie type of an abnormality is the pulmonary nodules, the 

20 ottier selection routine of the examination conditions is executed. TTiis routine Is shown in Fig. 116. First of all. in 817. 
it is judged as to whether or not a size of abnormal shadows is less than a predetermined diameter, herein a diameter 
5cm. When No in SI 7, namely a size of tiie abnomial shadows exceeds a predetermined diameter, the existence of the 
abnormality is considered to be substantially confirmed, and proceed to 818 and tfien it is judged that the additional 
examination is unnecessary According to tiiis judgement, the detected type of the abnormality "pulmonary nodules" 

2S and tiie message "No next examination" are displayed on the display unit 4K. On ttie other hand, when Yes in 817, 
namely a size of abnormal shadows is less than a predetermined diameter, it is judged that presence or absence of an 
abnormality is flexible containing the possibility in an erroneous detection and ttiat tiie additional examination is neces- 
sary, and the examination conditions of the additional examination in 819 and after are set. 
[0612] In 819, it is judged as to whether or not a position of an abnonnality exists in a specified region, herein in a 

30 vertical interval region. Here, if No. proceed to 820. and also if Yes. proceed to 826. In S20, it is judged as to whether 
or not a postion of an abnormality is in a specified position, herein in a right lung field. 

[0613] When No in 820. namely a position of an abnormality is not in a right lung field, but in a left lung field, S21 is 
canried out, and the Imaging direction in ttie examination conditions of the additional examination is set at R ^ L which 
is suitable for ttie imaging of ttie left lung field. Furthermore, when Yes in S20, namely ttie position of an abnormality is 

35 in the right lung field, S22 is carried out, and the imaging direction of ttie examination conditions of ttie additional exam- 
ination is set at L ^ R which Is suitable for ttie imaging in the right lung field. When ttie imaging direction of the exam- 
ination conditions of ttie additional examination is decided in 821 or S22. proceed to a judgement step of S23. In 823, 
it is judged as to whether or not a tube voltage of such examination is a predeterntined value, herein 1 20kV. There are 
some possibilities that a contrast off an image is reduced due to a high tube voltage, as ttiis result, an erroneousness in 

40 the degree of the abnormality by the CAD processing generates, and it is avoided by ttie additional examination based 
on ttils judgement. Accordingly, when No in 823. the examination conditions of tiie additional examination are set at a 
slightly lower value than a tube voltage of such examination, for example, a tube voltage of 90kV. Conrespondlng to ttiis 
tube voltage, the tube current is set at, for exanple. 200mA, and an exposing time is set at. for ecanple. 0.2 sec. On 
the ottier hand, when Yes in S23. similarly the examination conditions of the additional examination are set at a slightty 

45 lower value than the tube voltage of such examination, for example, ttie tube voltage of 1 15kV. Conesponding to ttiis 
tube voltage, the tube current is set at for example, 200niA. and tfie exposing time is set at for example, 0.15 sec. 
[0614] On ttie ottier tend, when Yes in Si 9, namely ttie position of an abnormality exists in a pedf ied regfon, herein 
in a vertical interval region, 826 is carried out. It is judged in S26 as to whether or not the tube voltage of such exami- 
nation is 120kV. Herein, when No, namely ttie tube voltage of such examination is not 120kV, ttie imaging direction off 

50 the additional examination is set at P A in 828, and successively ttie tube voltage of ttie additional examination is set 
at 120KV and ttie tube current is set at 100mA and ttie exposing time is set at 0.06 sec in 829. 
[061 5] When Yes in 826 (the tube voltage of such examination is 1 20kV), after the examination conditions of ttie addi- 
ttonal examination are set in 824, 825. or 829. proceed to 830. 830 is a step for setting examination conditions of an 
enlarging imaging. The examination conditions of ttie additional examination by ttie enlarging imaging to be set herein 

55 are: ttie imaging direction: P -> A; ttie tube vdatge: 1 20kV: the tube current: 100mA; the exposing time: 0.06 sec: the 
imaging position; and the positfon of an abnormality. 

[0616] The examination conditions of the additional examination set in S24. 825, or S29 and ttie examination condi- 
tions of the enlarging Image are displyed togettier with ttie message "Next examination" on the display unit 4K, and ttie 
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additional examination containing the enlarging imaging under these examination conditions is called forth. 
[0617] Thus, with this embodiment, such image is CAD-processed immediately after the image is acquired, and it is 
judged as to whether or not the additional examination is necessary based on these processing reailts. and also in the 
case where the additional examination is necessary, the examination conditions of the additional examination can be 
5 set to display to a radiographer. Accordingly, as the radiographer carries out the additional examination according to this 
display and the interpreting doctor can always interpret the excellent image, it can be avoided to delay due to a re- 
request of the examination and efficiency in work from the examination start to the interpreting completion can be real- 
ized. 

[0618] In this connection, in the above-mentioned description, the examination conditions of the additional examina- 

70 tion is just displayed, however an X-ray generator or an X-ray machine may be set according to these examination con- 
ditions. In this case, in regulating an imaging position or an imaging angle, a person to be examined is fixed while an 
inspection pedestal on which a person to be examined is placed is moved to an appropriate location like a digestive 
organ diagnostic apparatus, or a person to be examined is stationary while a radiography is moved to an appropriate 
location like a circulatory organ diagnostic apparatus, or a method can also be used in which the both are combined. 

IS Furthermore, in the above-mentioned description, the image acquisition unit is incorporated with the CAD processing 
unit or the next examination condition deciding means, however these may also be incorporated into an external unit, 
for example, a workstation or a database and the images acquired by the image acquisition unit are sent to the external 
unit, which may receive the decided next examination conditions to display Furthermore, this embodiment may not be 
an on-line PACS but an off-line PACS, or may not be a form of the PACS. Furthermore, this embodiment is equipped 

20 with a film digitizer, and films imaged by an X-ray analog machine are inputted from this film digitizer, and these images 
may be objects of judgements of presence or absence of necessity In the next examination or settings of the examina- 
tion conditions. Furthermore, in the above-mentioned description, the chest plain X-ray image was explained as an 
objective image of judgements of presence or absence of necessity in the next examination or settings of the examina- 
tion conditions, however this embodiment Is not limited to this image, and may be applied to the other types of image. 

25 for example a breast X-ray image, a stomach X-ray image, a cross-sectional image by an X-ray computed tomography 
machine, an MR image by a magnetic resonance imaging machine, or the like. Furthermore, in the above-mentioned 
description, the medical image was described as an object of judgements of presence or absence of necessity in the 
next examination, however this embodiment is not limited to this image, and may be applied to the other examination 
data, tor example graphic data such as an electrocardiogram, brain waves, or the fike. numerical value data by an auto- 

30 matte chemical analyzer or the tike. 

EmbodlmfflU Nq. 7-3 

[061 9] Next a third embodiment will be explained. 

55 [0620] In the same manner as the second embodiment, this embodiment indicates to a radiographer presence or 
absence of the next examination and the examination conditions immediately after completing the examination, in order 
to mitigate precision in the acquired images and troubles in a reexamination. An image detection unit according to this 
embodiment has the same configuration as Fig. 113 in the second embodiment. However, unlike the second embodi- 
ment, this embodiment uses a next examinatbn condition setting table which has beforehand been made in order to 

40 decide the necessity in the next examination and the next examination conditions for it. Therefore, this next examination 
condition setting table has belbrehand been made and is archived in the image storing unit 2G of Fig. 113. This next 
examination condition setting table is such a table that various combinations of a type of an abnormality which is 
detected in the CAD peocessing unit 2H. a size of an abnormality, a position of an abnormality, and an examining direc- 
tion are associated witii and corresponded to the necessity in ttie next examination, the examining direction of the next 

45 examination, and tiie examination conditions of the next examination (an imaging nrrade such as an enlarging imaging 
etc, , a tube voltage, a tube cun-ent, an imaging time). Fig. 1 39 shows an example in the case where a type of an abnor- 
mality is an Interstitial lung disease, and Fig. 140 shows an example in the case where it is pulmonary nodules. 
[0621] Operations for deciding the necessity in the next examination and the examination conditions for it by using 
this next examination condition setting table will hereinafter be described witti reference to a flowchart of Fig. 119. 

so [0622] In the step (SI), in order to obtain the examination request information and also perform a chest plain X-ray 
infiaging for a person to be examined, a radiographer sets imaging conditions such as a tube voltage, a tube current, or 
the like of tiie X-ray generator 2E from a physical characteristic of tiie person to be examined (an age, a sex. a ttiickness 
of body etc.). For example, in the case of the chest plain X-ray imaging of a male adult the tube voltage 80kV and ttie 
tube current 200mA are set. Also, for example an X-ray tube is arranged in the back side of tiie person to be examined 

55 and the X-ray machine 2F is arranged in the position opposing to ttie X-ray tube, namely on ttie belly side of ttie person 
to be examined, and the examining direction is set at P A orienting from the back side to tiie belly side. 
[0623] In the step (S2). tiie X-rays are exposed under ttiese conditions to acquire images. These acquired images are 
sent to the Image storing unit 2G ttirough ttie image bus 2A and temporarily stored. Then, in the step (S3), ttiese images 
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are sent to the CAD processing unit 2H under control of the control unit 2C and CAD-processed therein. 
[0624] These CAD processing results are supplied to the next examination deciding means 21. Also, at this time, the 
next examination condition deciding table is associated with the type of an abnormality based on these CAD proce^ing 
results and supplied from the image storing unit 2G to the next examination condition deciding means 21 by an instruc- 

5 tion of the control unit 2C. In the step (84), the next examination condition deciding means 21 checks a degree of an 
abnormali^ in the CAD processing results (or a size of shadows), a disease portion (or a position of an abnonnalrty). 
an examining direction, and a tube voltage with such next examination condition deciding table to judge the necessity 
in the next examination. Herein, if the next examination is not necessary, such processing is completed. On the other 
hand, if the next examination is judged to be necessary, the step (S5) is carried out 

10 [0625] In the step (S5). the next examination condition deciding table is also used. The examining direction of the next 
examination and the examination conditions off tfie next examination (an imaging mode such as an enlarging imaging 
etc.. a tube voltage, a tube cun-ent. an imaging time) corresponding to various conditions of ttie above-mentioned CAD 
processing results are read out from the next examination condition deciding table. For example, if the type of an abnor- 
mality is "pulmonary nodules". Fig. 1 40 is used. Then, in the CAD processing results, if. for example, a size of an abnor- 

IS mality is "1cm" and ttie position of an abnormality exists in a vertical interval region and in a right lung field, ttie next 
examination is necessary in any cases. The results are obtained tiiat two next examinations are necessary. That is, ttie 
one next examination is an examining direction: P A. an examination mode: an enlarged imaging, a tube voltage: 
120kV, a tube current: 100mA. and an imaging time: 0.06 sec. and the other next examination is an examining direction: 
the side L -> R, a tube voltage: 90kV. a tube cunent: 200mA. and an imaging time: 0.2 sec. When completing the step 

20 (S5), return to ttie step (S2) and ttie same processing is repeated until any images are not left. 

[0626] The thus-obtained checking results are displayed on the display unit 2K. The radiographer sets the examina- 
tion conditions according to ttiese display contains and executes promptiy tfie next examination, namely for a period 
when the person to be examined is not required to come again. 

[0627] Similarly, ttie necessity in ttie next examination is judged for the acquired images in this reexamination, and 

25 the examination conditions of the next examination after ttie next one are decided as occasion demands. This reexam- 
ination is repeated until the judging results are finally obtained ttiat the next examination is unnecessary. 
[0628] Thus, in tfiis embodiment, the same effects as ttie second embodiment are obtained. 
[0629] In ttiis connection, the present invention is not limited to ttie above-described errijodiment, of course it can be 
changed in various modes and executed wittiin ttie scope which does not deviate from the gist. 

30 [0630] This embodiment according to the present invention detects the type off an abnomiality as to each image of 
images for an examining doctor and a plurality of sheets of medical image archived in ttie archiving means, and accord- 
ing to ttiese delected results, that is such images are selectively displayed as images to refer to ttie medical images 
having the same type off an abnormality as the images for ttie examining doctor. Therefore, the reference image prep- 
aration supporting unit can be provided in which it is possible to prepare the images to refer to wittiout interposing an 

35 operator, and which ttie images can be prepared for the interpretation of the images for the examining doctor. 

[0631] Furthermore, this embodiment according to ttie present invention detects an abnormality by ttie abnormality 
detecting means as to the acquired Images, and as the detected results, the abnormality detecting means outputs data 
that the additional examination is necessary when the type of an abnormality is a specidied one and ttie degree of an 
abnormality exists within a predetermined scope, and urges to execute instantly ttie additional examination. Therefore. 

40 the image acquisition unit can be provided in which the additional examination can be executed immediately after the 
images are acquired wittiout awaiting ttie interpretation work of such Images, and which accordingly examination effi- 
ciency Is enhanced significantiy. 

Embodiment No. 7-4 

45 

[0632] Refening to FIG. 141 . fburtti variation of ttie seventii embodiment will be described. 
[0633] Suppose that a group examination is performed to detect the lung cancer by CT 

Step 1): The images are obtained in accordance with predetermined conditions such as: 

so 

* Imaging condition 

tube voltage at 120kV 
tube current at 50mA 
55 slice thickness of 1 0mm 

bed moving rate at 20mnfi/rotation 

* Imaging range 
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from 20inm above the collartx)ne to a leg side for 300mm 

* Image constructing condition 

image pitch at 10mm 

image reconstructing technique utilizing opposition Interpolating technique: 

Step 2): Immediately after the images are obtained, the lung cancer is detected by the computer utilizing a prede- 
termined process algorithm. 

Step 3): If no cancer Is found, stop here. If abnormality Is detected from the image, the Image shall be collected so 
that the position of the detected lung cancer is obtained under a precision examination condition (thin slicing etc.). 
When such image is collected under the precision examination condition, a bed portion is automatically moved to 
the image collecting position. Thereafter, the operator inputs an instruction to acquire the precision image so as to 
image the position in question. Hie im^e is obtained preferably with conditions such as: 

* Imaging condition 

tube voltage at 120kV 
tube cun'ent at 50mA 

slice thickness of 2mm (so as to obtain finer concentrated area) 
bed moving rate at 2mni/rotation 

* Imaging range 

from 20mm above an upper end of the detected lung cancer to 20mm below a lower end of the detected 

lung cancer (see Rg. 141) 

* Image constructing condition 

image pitch at 2mm 

Image reconstructing technique utilizing opposition interpolating technique: and 

Step 4): Thus-obtained images in Step 3) are corresponded to those obtained at Step 1) so as to be stored. 

[0634] It is appreciated that the operator may attend to move the bed portion while he/she only outputs the imaging 
conditions at the time of collecting addtttonal precision images. 

[0635] In this embodiment, the patient need not come again to go through re-examination (additional precision exam- 
ination), so that a burden for the patient is significantly reduced. Moreover, a cancer whose spreading rate is rather fast 
can be treated promptly Moreover, as for an examination-conducting side who runs the group examination, arrange- 
ment for the examination can be made easy: for example, the anangement for a exarhination car. examination doctors 
and interpreting doctors is simplified. Thereby, cost necessary tor the examination can be significantly reduced. 

Embodiment No. 8 

[0636] Hereinafter, the eighth embodiment according to the present invention will be described. Fig. 108 shows a 
schematic configuratton of a medical picture archiving communication system (PACS). 

[0637] A network (NW) 5 is a transmission path for an image communication among respective units and an optical 

fiber is used as a transmission medium in order to make an attempt to communicate at high speed. Herein, a ring-type 

local area network is adopted, of course the other types such as a slartype one or the like may be used. 

[0638] This network 5 is connected with a system manager (SM) 1. Image acquisition units (lA) 2a, 2b, a database 

(DB) 3, and workstations (WS) 4A. 4B. and the respective units can be mutually linked by means of a communication 

protocol. 

[0639] Furthermore, this network 5 is connected with an examination order system 7 through a gateway 6. This exam- 
ination order system 7 is equipped with inputting means of a keyboard etc. Examination request infomiation for request- 
ing an aquisition of images is inputted from the examination order system 7. One example of this examination request 
information is shown in Rg. 120. 

[0640] As Shown in FIG. 1 20. the examination request Information consists of respective items of a patient ID number, 
a patient name, a date of birth, a sex, a name of examtnatbn requesting department, a name of examination requesting 
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doctor, a modality of an exarrtnation (an X-ray machine, an X-ray computed tomography machine, a magnetic reso- 
nance imaging machine etc.). an examina-tion portion, a purpose of an examination, dinical information or the like. 
10641] The examination request information \s sent from the examination order system 7 to the system manager 1, 
[0S42] The system manager 1 transfers this examination request information to the appropriate acquisition unit 2a or 

[0643] The image acquisition units 2a. 2b are image acquisition units such as an X-ray machine, an ultrasonic diag- 
nostic apparatus, an X-ray computed tomography apparatus, a magnetic resonance imaging apparatus, or the like. 
These image acquisition units 2a. 2b assign an image number to a generated image in the order of its generation, and 
also attach annexed intonmation thereto as peculiar information conceming the image, and send to the database 3 
according to an instruction of the system manager 1 . An example of this anne)ffid information is shown In Rg. 1 21 . 
[0644] As shown in Table 121. the annexed information contains an examination ID. a date of an examination, an 
image number, an image size, a data amount and information concerning such image in the imaging direction. 
[0645] The system manager 1 creates examination histories from the examination request information or the 
annexted information and stores therein. One example of the examination is shown in Fig. 130 descrS)ed below. 
[0646] These examination histories are sent from the system manager 1 to the workstation 4B when interpreting 
images to refer to the tnterpretatbn. 

[0647] The interpretation report making support unit is incorporated with the workstations 4A, 4B. 
[0648] Fig. 148 is a block diagram showing a configuration of the workstation 4A. In this connection, as the worksta- 
tion 4B has the same configuration as the configuration of the workstation 4A as shown in Rg. 148, herein the descrip- 
tion of the workstation 4B is omitted, in the figure, reference numerals 4k and 4m are control buses (WS-CBUS). Also, 
the reference numeral 41 is an image bus (WS-IBUS). The image bus 41 is connected with the network 5 through a net- 
work interface 4j. Hereinafter, functions of each unit which Is connected with the control buses 4k, 4m. and the image 
bus 41 will respectively be described. 

(Control Unit (WS-CTRL)) 

[0649] The control unit 4a contains a central processing unit (CPU), a system memory (for example, a semiconductor 
memory}, or the like and controls operations of the entire workstation. 

(system disk (WS-SD)} 

[0650] The system disk 4b is. for exanple, a magnetic disk and archives various programs which are necessary to 
control operations of the entire workstation. These programs are read out into tiie cortrol unit 4a when an electric power 
is tumed on and are stored in a system memory within the control unit 4a. 

(Cliaracter Display Unit (WS-CDISP)> 

[0651] The character display unit 4d is a unit for displaying mainly character information such as an interpretation 
report etc.. and for exanple. a CRT (Cathode Ray Tube) display, a liquid crystal panel display, or the like Is used for this 
unit. 

( Imaging Frame Memory (WS-IFM) > 

[0652] An imaging frame memory 4g is. tor example, a semiconductor memory and teniporarily archives an original 
image to be interpreted which is transferred from tiie database 3. 

( Image Storing Unit (WS-IM) > 

[0653] An image storing unit 4f is. for example, a magnetic disk and temporarily stores examination request informa- 
tion to be treated during interpreting operattons, an interpretation report image annexed information, original image 
data, overlay display information, an abnormality data table, or the like. Also. The image storing unit 4f archives abnor- 
mality detecting means selection information. One example of tiiis abnormality detecting means selecti(»i information 

is shown in Fig. 124. 

[0654] This abnormality detecting means selection information is information for selecting tiie abnormality detecting 
means capable of being applied each type of an original image, and is sent to a CAD processing unit 4e when compu- 
ter-aided diagnostic functions are activated. 

[0655] The image storing unit 4f further stores a typical sentence table. An example of this typical sentence table is 
shown in Fig. 142. 
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[0656] in Rg. 142, a drde shows presence of each information of a type, a position, a degree, and a concfitlon of an 
abnormality. 

[0657] This typical sentence table contains a plurality of types of typical composition tor constituting the type, position, 
or degree of an abnormality detected in the below-described CAD processing unit 4e as a predetermined sentence. 
The typical sentence shows a typical composition structure when preparing conqx)8itions. Herein. 12 types of this typ- 
ical sentence exist. Each typical sentence is different in a combination of each information of the type, position, degree, 
and condition of an abnormality. This typical sentence table is sent to an interpretation report composition making unit 
4r described below when an interpretation report is produced. Then, a basic sentence type far constituting a composi- 
tion concerning the type, position, and degree of an abnormality detected by the CAD processing unit 4e is selected 
and is used tor making a composition for the type, positton and degree of an abnormality according to this basic sen- 
tence type. 

< CAD processing unit (WS-CADP) ) 

[0658] A CAD processing unit 4e is a unit in charge of a Computer-Aided Diagnosis (CAD) and archives a plurality of 
types of abnormality detecting means. For example, the abnormality detecting means has (a) means tor detecting shad- 
ows of an interstitial lung disease in a frontal image of a chest plain X-ray image; (b) means for detecting shadows of 
pulmonary nodules in a frontal image of a chest plain X-ray image; and (c) means for detecting shadows of a fine cal- 
cification of a breast in a breast X-ray image. These abnormality detecting means are selectively used based on the 
abnormality detecting means selection information. 

[0659] The abnormality detecting means judges presence or absence of an abnormaTity, a center position of an 
abnormality on an image (XY coordinates), a degree of an abnonmality. and a spadal magnitude of an abnormality. 
[0660] Furthermore, the CAD processing unit 4e comprises means for spedfying a dissecting division in accordance 
with coordinates on an image matrix judged by the abnormality detecting means. Herein, the dissecting regional divi- 
sion is, for example in lungs, trisected vertically in each of two right and left lungs, and each of the divisions is respec- 
tively called an "upper left lung field", a "middle left lung field", a lower left lung field", an "upper right lung f ^eld^ a 
"middle right lung field", and a "lower right lungfieki*. 

[0661] This specifying mean has various ones, and a technique adopted herein has been disclosed in Japanese Pat- 
ent Application Laid-Open No. 1 -125675. In this connection, the dissecting division of ttie lungs should precisely be sec- 
tioned based on the position relationship with a tip of a rib, however as it is difficult to recognize the tip of rto by a 
conputer. in the above-mentioned technique, generally by using a fact that a lower edge of tiie collarbone exists in a 
center position of the upper lung field and that an upper edge of the diaphragm coinddes with a tower edge of the lung 
field, based on the position relationship of the tower edge of the collarbone with the upper edge of the diaphragm as it 
is easy to comparatively recognize tiiem from an image, it is possible to recognize a scope of each division on the 
image. If the center position of the abnormality is checked up witii the coordinates on the image which specify each 
region, it is possible to specify tiie dissecting division relating to the position of the abnormality. This specified dissecting 
division is hereinafter called a "region containing an abnormality". 

[0662] The CAD processing unit 4e finally creates an abnormality data table showing one example in Fig. 129 by 
using judgement results of the abnormality detecting means or the region containing an abnormality. 
[0663] The abnormality data table consists of respective items of a reference number, an examination ID number, a 
type of an abnormality, a center position of an abnormality on an image, a degree of an abnormality, and a region con- 
taining an abnormality. This abnormality data table is transferred to ttie image storing unit 4f to stand by until tiie time 
of displaying the abnormality intormation. 

(Input Unit (WS-INPUT)) 

[0664] An input unit 4c is inputting means for inputting various commands such as an image search etc. or character 
information etc. by an interpreting doctor, or for connecting overlay display information, and are, for example, a keyboard, 
a mouse, a light pen, a touch screen, or voice inputting means. 

[0665] This voice inputting means picks up a votoe generated by an interpreting doctor by a microphone and recog- 
nizes his/her sound signals, and makes a code conversion ttie signals and outputs ttiem as a coding scheme, ttiereby 
fetching various commands or input information in the same manner as inputting means tiirough a keyboard. 

< Overlay Display Information Making Unit (WS-OVMK) > 

[0666] An overlay display information making unit 4n inputs ttie abnormality data table stored in ttie image storing unit 
4f and makes an element of an image expressing the type, position, and degree of an abnornallty based on ttiis abnor- 
mality data table (hereinafter, referred to as an "overlay display infonnati'on'). 
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[0667] One example of this overiay display information is shown in Fig. 1 43 described below. 
[0668] As shown in FIG. 143. in this overiay dsplay information, graphic informatfon of a marker for showing the posi- 
tfon of an abnormality on the image is added to the abnomriality data table. In this connection, a -position" in the overlay 
display informa-tion means a "region containing an abnormality" specified in the CAD processing unit 4& Graphic infor- 
mation of a marker Is the previously set Information and consists of each infbnnation of a type of a graphic, a size of a 
graphic, and a display color. 

[0669] This overiay display information is sent to the Image storing unit 41 and stored therein. 
( Image Display Manager (WS-IDM) ) 

[0670] The image display manager 4h maizes a display image by super-imposing the overlay display information on 
the original Image. This configuration is shown in Fig. 3. 

[0671 ] The original image sent through the image bus 41 is sent to an overlay portion 44 through an image memory 42. 
[0672] A control portion 40 is connected with the control bus 4k and the overiay display information concerning such 
original image Is Inputted from the image storing unit 41 This overiay display information is sent to an overiay data mak- 
ing portion 41 , which is converted into overlay data (images composed of abnormality information) having the same 
image matrix as the original image. 

[0673] These overiay data are sent to the overiay portion 44 through an overlay memory 43a. In this connection, an 
overlay memory 43b is a memory for a cursor display for displaying a cursor on an image corresponding to a mouse. 
The data in this memory are sent to the overiay portion 44. 

[0674] The overlay portion 44 makes a display image by synthesizing the original image data, the overlay data, and 
the cursor display data. This display image is sent to the display unit 4i through a displaying menrwry 45 and a D/A con- 
verter 46. 

( Image Display Unit (WS-IDISP)) 

[0675] An image display unit 4i is .for example, a color CRT display and a plurality of units, herein four units, are pre- 
pared. 

[0676] Ref em'ng back to Fig. 1 48, the description is hereinafter continued. 
(Overlay Display Information Correction Unit (WS-SCR) ) 

[0677] An overiay display information correction unit 4p is for conrecting overiay display Informatfon. 
[0678] This correction is canied out by operating the input unit 4c while an interpreting doctor observes a display 
image of the display unit 4i. Fa example, when an interpreting doctor discovers an abnoramlity which cannot be 
extracted by the CAD processing unit 4e, a cursor is put on the position on a screen by ti-aveling a mouse to add the 
position information of an abnormality tiiereto. This position information is converted into a "region containing an abnor- 
mality" by the CAD processing unit 4e. Also, a type or degree of an abnormality is inputted by operating a keyboard of 
the input unit 4c. Each information of the region containing an abnormality and the type and degree of an abnormality 
is added to the overlay dispaly information by the overiay dlspaly information correction unit 4p Also, when a doctor 
desires to delete an abnormality extracted by the CAD processing unit 4e. a cursor Is put on a mariner to be deleted on 
the screen by traveling a mouse to indicate a deletion. In this connection, at this time, as shown in Rg. 149. by setting 
a comparatively wide scope as shown by an oblique line (for example, a circular scope having the radius 32 pixels) as 
a moving pitch of a cursor, it is possible to dissolve troubles in putting a cursor on a marker by one pixel unit. The cor- 
rected overlay display information is sent immediately to the image display manager 4h. Based on tills con-ected overiay 
display information, the overlay data are newly made, this newly made overlay data are syrthesized with the original 
image to display on the display unit 4t. 

( Interpretation Report Confiposition Making Unit (WS-SMAKE)> 

[0679] An interpretation report composition making unit 4r makes a finding composition of an interpretation report 
based on the overlay display Information to complete the Interpretation report. The Interpretation report Is shown in Ra 
122. 

[0680] An interpretation report is constituted of information concerning a patient. Information concerning an examina- 
tion, a finding of an interpreting doctor, and a conclusion. 

[0681] As information concerning a patient and information conceming an examination exist in the examination 
request information, tiie annexed Information, and the abnormality data table, such information is created by duplicating 
the Information solely. An interpreting doctor's finding was aeated by conventionally operating a keyboard and manually 
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inputting it by him/her. The interpretation report composition maWng unit 4r automatically makes this finding. 
[0682] In short, the Interpretation report composition making unit 4r letches each Intbnmation of the type of an abnor- 
mality, the degree of an abnormality, and the position of an abnormality from the overlay display Information and spec- 
ifies a corresponding typical sentence from the typical sentence table according to presence or absence of each 
information, and arranges each infor-mation in a predetermined position of the typical sentence, thereby maWng a com- 
position of a finding. The interpretation report composition nrmking unit 4r incorporates this finding with the information 
concerning a patient and the information conceming an examination to complete the interpretation report. This inter- 
pretation report is sent to the image diaplay manager 4h to display on the display unit 4i. 

( Composition Addition/ Deletion Unit (WS-ID)) 

[0683] A composition addition/ deletion unit 4q contains character inputting means of a keyboaid etc. and is made so 
that an interpreting doctor may read an interpretation report displayed on the display unit 41 and add newly worxis or 
sentences to the contents of finding as occasion demands or delete unnecessary parts. 
[0684] Next operations of this embodiment constituted above will be explained. 

(1) Request of an examination 
[0685] 

1-1) Examination request information inputted through the exami-natlon order system 7 is sent to the system man- 
ager 1. An embodiment of this examination request information is shown in Rg. 132 described below. 

This example consists of a patient ID number: 870802. a name of a patient:for example. E. Suzuki, a sex: infor- 
nration concerning a patient of a male etc.. a modality: X-ray, an examination portion: chest, and a procedure of an 
examination: information concerning an examination such as a plain radiography etc. 

1- 2) This examination request information is transferred to an appropriate unit, herein tiie image acquisition unit 2a 
or 2b of the X-ray machine by the system manager 1 . 

(2) Acquisition and archival of an image 
[0686] 

2- 1) A radiographer carries out an image acccording to the examination request information to produce an imaga 
2-2) This image information is assigned an image number in the sequential orcler of the generation, and the 
annexed information is also attached ttiereto. An embodiment of ttie annexed information is shown in Fig. 133. 

[0687] The image Informatton is sent to the database 3 together witti an image number or an annexed information 
and archived therein. 

(3) Readout of examination histories or the like 

[0688] Belbre an interpretation, examination histories of such patient a previous Interpretation report and examina- 
tion request information which are to be refenred to at ttie interpretation are read out from the database 3. and sent to 
the worksta-tion 4A and archived in tfie system memory. An embodiment of ttiese examination histories is shown in Fig. 



(4) Readout of an image to be interpreted 

[0689] An interpreting doctor Inputs a readout demand of a desired image to be Interpreted through the input unit 4c 
of tfie worksta-tion 4A. This demand Is sent from the database 3 through the system manager 1 . Such Image informa- 
tion Is read out from the database 3 and sent to ttie image storing unit 4f and tenporarily stored therein. 

(5) Computer-aided diagnosis processing 

[0690] The image stored in the Image storing unit 4f is sent to the CAD processing unit 4e according to an instruction 
of tiie control unit 4a. 

[0691 ] As described above, the CAD processing unit 4e comprises three types of abnormafity detecting means of (a) 
means for detecting shadows of an interstitial lung disease in a frontal image of a chest plain X-ray Image; (b) means 
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for d^ecting shadows of pulmonary nodules In a frontal Image of a chest plain X-ray image; and (c) means for detecting 
shadows of a microcaldf ication of a breast in a breast X>ray image. 

[0692] By using the abnormality detecting means selection information of Fig. 124, the CAD processing unit 4e spec- 
ifies the detectable type of an abnormality concerning this image and selects the abnormality detecting means accord- 

5 Ing to these results. Herein, as an examination portion is a chest and a procedure of an examination is a plain 
radiography and an imaging direction is P A. the CAD processing unit 4e selects the abnormality detecting means 
capable of detecting an interstitial lung disease and the abnormality detecting means capable of detecting lung nodules. 
[0693] By the selected abnormality detecting mear«, the abnormality detecting processing is executed as to an orig- 
inal image to judge presence or absence of an abnomiality, a type of an abnonnayty (to be decided at the time when 

10 the abnormality detecting means Is selected), a position of an abnormality, and a degree of an abnormality. Also, if the 
position of an abnormality is in a region containing an abnormality of the dissecting division, for example an examination 
portion is in the lungs, it is recognized to which region of the "upper left lung field", the "middle left lung field", the "lower 
left lung field", the "upper right lung field", the "middle right lung field", and the lower right lung field" the position of an 
abnormality belong. The abnormality data table is made by using presence or absence of an abnormality, the type of 

IS an abnormality, the position of an abnormality, the degree of an abnormality, the region containing an abnonmarrty. the 
image number, and the examination ID number 

[0694] An embodiment of the abnormality data table made by the CAD processing unit 4e is shown in Fig. 135. 
[0695] The abnormality data table made by this CAD processing unit 4e is sent to the image storing unit 4f and stored 
therein. 

20 

(6) Creation of overlay display infbmiation 

[0696] The abnormality data table is sent from the image storing unit 4f to the overlay display information making unit 
4n. The overlay display Information is made based on this abnormality data table. An embodiment of this overlay display 
25 information is shown in Fig. 144. 

[0697] As shown in FIG. 144, in the overlay display information, each information of a type of a graphic of a marker, 
a size of a graphic, and a display color of a graphic which have beforehand been set is added to the abnonmality data 
table. 

[0698] A graphic of this marker is . for example, an arrow in a real line and in 32 X 32 dots, as shown in Fig. 1 50. and 
30 then a display color is decided to be white. At displaying, a tip of an arrow is allocated in the coordinate position of the 
overlay display information, and the type and degree of an abnormality come dose to the marker to display by charac- 
ters. 

[0699] This overlay display information is sent to the image storing unit 4f and stored tiierein. 
35 (7) Creation and display of a display Image 

[0700] The original image and the overlay display information are sent from the Image storing unit 4f to the display 
manager 4h by an instruction of the control unit 4a. The original image is sent to the overlay portion 44 tiirough the 
image memory 42. Also, the overlay display information is sent to an overlay data making portion 41 through the control 
40 unit 4a. and markers concerning all abnormalities are anranged on an image matrix of the original image to make the 
overlay data as the image information concerning an abnormality 

[0701] As to. for example, the reference number 1 of Fig, 144. as shown in Fig. 150, a tip of a marker is arranged in 
the coordinate (350, 1350) on the image matrix of the original image. Character infomiation of the degree of an abnor- 
mality "9" and the type of an abnomiality "interstitial lung disease" is anranged in a position close to ttiis marker by using 
45 a character font. 

[0702] These overlay data are sent to the overlay portion 44 through the overiay memory 43a, and are synthesized 
with the original image to create a display image. This display image is sent to the display unit 4i through the displaying 
memory 45 and the D/A converter 46 and displayed therein. One exanple of this display screen is shown in Fig. 151 . 

so (8) Creation of an interpretation report 

[0703] The overlay display information and the typical sentence table of Fig. 1 44 is sent from the image storing unit 
4f to the interpretation report composition making unit 4r by an instruction of the control unit 4a. The Interpretation 
report compositfon making unit 4r separately judges as to whether or not each infbmiation of the type of an abnormality 
55 and the position of an abnomiality and the degree of an abnormality in the overlay display information exist. 

[0704] As the results of judgement, a combination of these present information is checked with the typical sentence 
table of Rg. 142 to select the typical sentence corresponding to such combination. For example, in the case of the ref- 
erence number 1 in Fig, 144. as each information of the type of an abnormality and the position of an abnormality and 
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the degree of an abnormality exists, the typical sentence of the number 6 of the typical sentense table is selected. 
[07051 The composition structure of this typical sentence is that a lype" of an abnormality is recognized in a -position" 
at a "degree". The information of the type of an abnornwlity and the position of an abnormality and the degree of an 
abnormality which are picked up from the overlay display information is set to this composition structure, in order to 
make the composition that "a pulnwnary interstitial disease is recognized in a lower right lung field at a degree 9'. This 
created composition is inseted into finding items of an interpretation report to complete the interpretation report 
together with infbrmatfon concerning the patient or information concerning tiie examination. As the information con- 
cerning the patient and the information concerning the examination exist in the examination request information, the 
annexed intbnnation, and the abnormality data table, the interpretation report is made by duplicating the information 
solely The interpretation report made based on the overlay display Information of Rg. 144 is shown In Rg. 145. 
[0706] TTiis interpretation report is sent to the character display unit 4d and displayed therein. 

(9) Indirect correction of an interpretatton report 

[0707] In order to indirectiy correct an interpretation report, the overlay display information is con-ected by the overlay 
display information connection unit 4p. 

[0708] The correction of the overlay display information is canied out as follows: That is. an interpreting doctor oper- 
ates the input unit 4c while he/she observes a display image of the display unit 4i. For example, when the interpreting 
doctor discovers the abnormality which could not be extracted by ttie CAD processing unit 4e. he/she puts a cursor on 
a screen on tiie portion by traveling a mouse to add the position information of an abnormality thereto. This position 
information is converted into a "region containing an abnormality" by the CAD processing unit 4e. Also, the type or 
degree of an abnormality is Inputted by operating a keyboard of the input unit 4c. Each of the information of the region 
containing the abnormality and the type and degree of the abnomiality is added to tfie overlay display information by 
the overlay display information correction unit 4p. Also, when the doctor desires to delete the abnormality exteracted by 
the CAD processing unit 4e, he/she puts a cursor on a marker to be deleted on a screen by traveling a mouse and indi- 
cates to delete it. At this time, as shown in Fig. 1 49, a comparative wide scope as shown by an oblique line (for exairple, 
a circular scope having the radius 32 pixels) is set as a moving pitch of a cursor, whereby it is possible to dissolve trou- 
bles in putting a cursor on a marker by one pixel unit. This con'ected overlay display information is immediately sent to 
the Image display manager 4h. Based on this con^cled overlay display information, the overlay data are newly created 
and this newly created overlay data are synthesized with an original image to display on the display unit 4i. 
[0709] Herein, procedures of the correction will be concretely explained with reference to tiie case where the data of 
the reference number 2 of Fig. 144 are corrected. 

[071 0] The data of the reference nunt>er 2 are the type of an abnormality "pulmonary intei-stitial disease", the degree 
of an abnormality '8". and the position of an abnonnality "middle right lung field". This is corrected to ttie type of an 
abnormality "pulmonary nodule shadows", the degree of an abnormality "6". and tiie position of an abnormality "lower 
right lung field". 

[0711] The mouse of the input unit 4c is traveled by ttie interpret-ing doctor and ttie cursor on a screen is moved to 
the position of a tip of the marker displayed thereon (the coordinate (400. 1500)) according to the data of the reference 
number 2. A deletion instruction is inputted from the mouse in this position. This inaction is sent to the overlay display 
information connection unit 4p and the data concerning the reference number 2 of the overlay display information is 
deleted according to this deletion Instruction. 

(071 2] Then, ttie cursor is moved to the position in which an abnor-mality is confirmed, for example the position of the 
coordinate {300. 1500) on a screen. The instruction of information addition is inputted from ttie mouse in ttiis position. 
In response to the input of this information addition instruction, tiie prompts Input the type of an abnormnalityl" and 
"input the degree of an abnormality" are displayed on the character display unit 4d. According to these pronpts, "pul- 
monary nodule shadows" and "6" judged by the interpreting doctor are inputted from a keyboard of the input unit 4c. At 
this time, when the type or ttie degree of an abnormality is not proved positively, ttie doctor does not need to input these 
information. At ttiis time, tiie doctor immediately inputs an input completing instruction. Herein, as the presentiy inputted 
position is coordinate information, this is required to be replaced with a dissecting division. For tiiis reason, the coordi- 
nate information is sent to the CAD processing unit 4e. Therein, it is judged which dissecting division the position of 
such coordinate fells under. As these results, ttie positton off such coordinate corresponds to the "lower right lung field". 
Each of the thus-inputted information of the coordinate (300. 1500), the type of an abnormality "pulmonary nodule 
shadows", the degree ttiereof "6", and the position of an abnormality "lower right lung field" is added to ttie overlay dis- 
play information as ttie information of ttie latest unused reference number 2 by ttie overlay display information correction 
unit 4p. 

[071 3] This connected overlay display infonnatlon is immedialely sent to the Image display manager 4h. Based on ttiis 
con-ected overlay display infonnation, ttie overiay is newly created and ttiese overiay data are newly synttiesized witfi 
the original image to display on ttie cfisplay unit 4i. 



Patent provided by Sughru^ion, PLLC - http://www.sughrue.com 



EP 0 973 116 A1 



[071 4] Furthermore, this corrected overlay display infamation is sent to the interpretation report conposition making 
unit 4r. and the finding 2 is altered therein to the contents "the pulmonary nodule shadows are recognized in the lower 
right lung field** at the degree of the abnormality 6" according to this overlay display information to make the new altered 
interpretation report to display on the character display unit 4d. The finding 2 is altered into the composition "the lung 
nodule shadows are recognized in the middle right lung field at the degree thereof 6". This new interpretation report is 
shown in FIG. 146. 

(10) Direct correction of an interpretation report 

[071 5] As for the direct conrection of an interpretation report, an interpreting doctor reads the interpretation report dis- 
played on the character display unit 4d and con-ects directly the contents from a composition addition/ deletion unit 4q. 
For example, the composition con^esponding to the reference number 1 of Fig. 144 "an interstitiai lung disease is rec- 
ognized In a lower right lung field at a degree of an abnormality 9" is conrected to the more embodied contents "a pul- 
monary interstitial disease is recognized in a lower right lung field in a degree of an abnormality 9 expanding to a wide 
scope". In short, the paragraph "expanding to a wide scope" is added thereto. This new interpretation report is shown 
in FIG. 147. 

[0716] In this case, in the same manner as an Insertion mode by a word processor functions, a cursor is moved to a 
position to be added to input a paragraph to be added by a key. In the case of deletion, operations are earned out in the 
same manner as deletion operations by the word processor functions. 

[071 7] Thus, the complete Interpretation report is completed. This complete interpretation report is sent to the image 
storing unit 4f. Then, this interpretation report is transfened from the image storing unit 4f to the system manager 1 . and 
archived therein and stands by for a readout demand from an examination requesting doctor. After passing through the 
preceding steps, the interpretation work has been completed. 

[0718] As described above, according to this embodiment, the interpretation report is automatically made based on 
the CAD processing results and the contents can be corrected from time to time as occasion demands, whereby the 
work amount can remarkably be reduced as compared with the case where the interpreting doctor manually inputs the 
interpretation reports, in particular, findings in the conventional practice. 

[0719] The present invention is not limited to the above-described embodiments and can be changed into various 
modes to realize. For example, in the above-mentioned description, the display image is an image that the overlay data 
are synthesized with the original image, however it may be a contour image instead of the original image. Also, in the 
above-mentioned description, one type of an arrow in a real line was used in the type of a graphic, however, for exam- 
ple, the other types such as an anow in a dotted line or the like can selectively be added thereto as shown in Fig. 152. 
In this case, for example, a marker corresponding to the settled findings can be expressed with an anow in a real line, 
and a marker conesppnding to the unsettled findings can be expressed with an arrow In a dotted line, so that the settled 
conditions can be distinguished by the type of a graphic to display. Further, in the above-mentioned description, one 
type of the types of a graphic and the display colors was used, however the graphic or display color may be altered each 
type of an abnormality to display by using the plurality of types of a graphic such as a round, a square, or the like or the 
plurality of display colors such as red, blue, or the like. 

[0720] The interpretation report making support unit according to ttie present invention comprises: means for inputting 
the image: means for detecting the type and position of an abnormality included in the image: means for storing the typ- 
ical sentences to constitute the type and position of an abnomiality as the predetermined compositions; and means for 
making the compositions containing the type and position of an abnormality which are detected by the detecting means, 
based on the typical sentences. As the compositions containing the type and position of an abnormality which are 
detected by tiie detecting means are made based on the typical sentenses, it is possible to provWe the interpretation 
report making support unit in which tiie troubles in manually Inputting these compositions in the conventional practice 
can be saved and the work in making the interpretation report can be made optimally efficient. 
[0721] Besides those already mentioned above, many modifications and variations of the above embodiments may 
be made wittiout departing from the novel and advantageous features of ttie present invention. Accordingly, all such 
modifiactions and variations are intended to be included within the scope of tiie appended claims. 

Claims 

1. A medical information processing system for supporting diagnosis, the system conprising: 

storage means for storing a plurality of medical images: 
input means for inputting an uninterpreted medical image: 

abnormality detection means for detecting abnormality in the the uninterpreted medical image: 

selection means for selecting the medical image in accordance with abnormality detected in the uninterpreted 
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medical image: and 

display means for displaying simultaneously the medical Image selected by the selection means, and the 
examination mecfical image. 

The system of daim 1 , wherein the abnonmality detection means detects a type of abnormality In respective unin- 
terpreted medical images. 

TTie system of daim 1, wherein the selection means select the medical Images in a manner that respective plural 
medical images are given priorities. 
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FIG.123 

(a) A first priority is an examination that is applied to 
the identical examination portion and by the identical modality (Xn-ay) 
to an uninterpreted examination ; and that 
has the identical type of an abnormality and the identical 

position of an abnormality to CAD prooesang results an unin- 
terpreted examination I and that 
is before an examination for starting a medical treatment or 
an examination having a change in the condition of a disease of 
a patient 

(b) A second priority is» m the sequential orda- of a date, all 
examinations that 

are applied to the identical examination portion and by the 
identical modality (X-ray) to an unmterpreted examination ; and that 

have the identical type of an abnormality and the identical 
position of an abnormality to CAD processing results of an unin- 
terpreted examination ; and that 

have a later date of an examination than that of (a}. 



FIG.124 

(a) A first priority is an examination that 
is applied to the identical examination portion and by the 
identical modality (X-ray) to an uninterpreted examination ; and 
that 

has (he Identical type of an abnormality and the identical 
position of an abnormality to CAD processing results of an unin- 
terpreted examination ; and that 

has an older date of an examination. 

(b) A second priority is, in the sequenlial order of a date, all 
examinations that 

are applied to the identical examination portion and by the 
Identical modality (X-ray) to an uninterpreted examination and 
that 

have the identical type of an abnormality and the identical 
position of an abnormality to CAD processing results of an unin- 
terpreted examination ; and that 

have a later date of an examination than that of (C). 
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FIG.125 
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the different modality (tomography) from an uninterpreted exami- 
nation ; and that 

has a later date of an examination. 

(b) A second priority is an examination that 

has CAD processing results of an uninterpreted ecamlnation I 
and that 

is applied to the identical examination portion to and by 
the different modality (CT) from an uninterpreted examination ; 
and that 

has a hiter date of an examination. 

(c) A third priority is an examination that 

has CAD processhig results an uninterpreted examination ; 
and that 

is applied (o the identical examination portion to and by 
the different modality (MR) horn an um'nterpreted examination ; 
and that 

has a biter date tS an examination 
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^ 

(a) A first priority is an examination that 

CAD processing results of an uninterpreted examination are an 
interstitial lung disease ; and that 

is applied to the identical examination portion to and by 
the different modality (Ga scintillation) torn an uninterpreted 
examination ; and that 

has a later date of an examination. 

(b) A first priority is an examination that 

CAD processing results of an uninterpreted examination are a 
pulmonary emphysema ; and that 

is applied to the identical examination portion to and by 
the different modality (pulmonary hematocele, pulmonary inhala- 
tion scintillation) from an uninterpreted examination ; and that 

has a later date of an examination. 

(c) A first priority is an examination that 

CAD processing results of an uninterpreted examination are a 
cancer ; and that 

is applied to the identical examination portion to and by 
the different modality (Rl) from an uninterpreted examination ; 
and that 

has a later date of an examination. 

(d) A second priority is an examination that 

CAD processing results of an uninterpreted examination are a 
cancer ; and that 

is applied to the identical examination portion to and by 
the different modality (Ga scmtiUation) from an uninterpreted 
examination ; and that 

has a later date of an examination. 

(e) A third priority is an examination that 

CAD processing results of an uninterpreted examination are a 
cancer ; and that 

is applied by the different modality (bone scintillation) 
from an uninterpreted examination ; and that 
has a later data of an examination. 

(f) A fourth priority is an examination that 

CAD processing results of an uninterpreted examination are a 
cancer ; and that 

is applied by the dlflferent modality (head CT) from an 
uninterpreted examination ; and that 
has a later date of an examination. 
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(a) A first priority is an examination that 

is applied to the identical examination portion to and by 
the identical modality to an uninterpreted examination ; and that 
has a later date of an examination. 

(b) A second priority is an examination that 

is applied to the identical examination portion to and by 
the identical modality to an unintopreted examinatioD ; and that 
has an older date of an examination. 

(c) A third priority is an examination that 

is applied to the identical examination portion to and by 
the different modality ^m an uninterpreted examination and that 
has a hito- date of an examination. 

(d) A fourth priority is an examination that 

is applied to the identical examination portion to and by 
the different modality from an uninterpreted examination i and that 
has an older date of an examination. 

(e) A fifth priority is an examination that 

is applied to the diiferent examination portion from and by 
the Identical modality to an uninterpreted examination ; and that 
has a later date of an examination. 

(f) A sixth priority is an examination that 

is applied to the diiferent exammation portion from and by 
the identical modah'ty to an uninterpreted examinalion ; and that 
has an older date of an examination. 

(g) A seventh priority is an examination that 

is applied to the different examination portion from and by 
the diiferent modality from an uninterpreted examination ; and that 
has a later date of an examination. 

(b) An ei^th priority is an examination that 

is applied to the different examination portion from and by 
the different modality from an uninterpreted examination ; and that 
has an older date of an examination. 



Patent provided by Sughrue l^iotLPLLC - http://www.sughrue.com 



EP0 973116A1 



FIG.128 



In a typical disease example image. 
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CAD processing results of an uninterpreted examination are a 
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its size is 1cm or more i and that 
is applied to the identical examination portion to and by 
the identical modality to an uninterpreted examination » and that 

is a plurality of typical disease examples that are made a 
benign judgement. 

(b) A second priority is an examination that 

is applied to the identical type of an abnormality to and 
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the different poation of an abnormality from CAD processing 
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